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AN OVERVIEW OF THE OREGON STUDIES IN EDUCATIONAL RDD&E 



In the spring of 1970 the Training Branch of the U.S. 
Office of Education, National Center for Educational 
Research and Development, announced a plan to effect 
change in the preparation of educational RDD&E person- 
nel. Two factors led to the announcement. The underlying 
factor was the rather dramatic emergence in the pa t decade 
of development, diffusion, and evaluation activities as 
vehicles for educational improvement, and the attending 
need for qualified personnel to carry them out. The 
precipitating factor, however, was evidence that in spite of 
an investment of approximately 30 million dollars by the 
Federal Government to help training programs become 
more responsive to the personnel needs created by these 
new activities, essentially the same number and kind of 
personnel were being prepared in 1970 as in 1965. 

The plan for change reflected a strategy that can best be 
described as “beginning at the beginning.” It incorporated 
three interrelated lines of activity: the creation of a 
conceptual and empirical base on which to build functional 
training programs; the design of more effective and efficient 
approaches to training; and the development of instruc- 
tional materials that reflect desired changes in both content 
and procedure. The propositions on which the plan rested 
were straightforward: (a) little was known about edu- 

cational development, diffusion and evaluation activities, or 
how they related to educational research; (b) even less was 
known about the training of personnel to carry out such 
activities; and (c) until both of these conditions were 
remedied the likelihood of designing effective and efficient 
programs to prepare personnel to carry them out was slight. 
The plan as a whole was coordinated so that the various 
activities within it would be developed with sensitivity to 
each other, and so that they would come together in 
completed fashion at approximately the same point in time. 
(For additional details on tire plan for change see Chapter I 
in Volume I of the series reporting the Oregon Studies.) 

The Oregon Studies, carried out by the Teaching 
Research Division of the Oregon State System of Higher 
Education, were to contribute in a beginning way to the 
conceptual and empirical base called for in the plan. As 
such they were to produce five products: a collection of 
detailed “case study” descriptions of projects that illus- 
trated exemplary RDD&E activities within various edu- 
cational contexts; a reliable, economically feasible method- 
ology by which to collect the data needed to prepare the 
case studies; a conceptual system or framework for viewing 
the domain of educational RE DAE that could be used as a 
guide to the classes of data 'o be attended to in the case 
studies; cross-project analyses that highlighted. the simi- 



larities and differences observed in the projects described, 
and that tested in rudimentary fashion the adequacy of the 
conceptual framework underlying those observations; and a 
compendium of the existing literature that pertained to 
either the nature of or the interactions between activities 
labeled educational research, development, diffusion and 
evaluation. These products are reported in five volumes: 



Volume I. Summary Report (with Technical 
Appendices) 

Volume II. The Literature of Educational RDD&E 
Part One (Research, Evaluation, and 
Development) 

Part Two (Diffusion & Combinations of 
RDD&E) 

Volume III. Conceptual Frameworks for Viewing 
Educational RDD&E 



Volume IV. Profiles of Exemplary Projects in 
Educational RDD&E 
Part One (Research and Evaluation) 
Part Two (Development) 

Part Three (Diffusion) 

Volume V. A Methodology for the Study of 
Educational RDD&E 



Each volume in the series reporting the Studies has been 
designed to stand alone, but because each volume reports a 
different product, and each product can be understood 
fully only in relation to the other products, two “reader’s 
guides” to. the series have been prepared. The first involves 
brief summaries or abstracts of the contents of each of the 
five volumes in the series. These appear on the inside of the 
back cover of the volume, and are intended to serve as a 
guide or overview to the series as a whole. A more detailed 
guide is provided by Volume I. In addition to serving as a 
general summary of the Studies, it contains descriptions of 
the developmental histories of the products reported in the 
various volumes, the relationships that exist between them, 
and the manner in wl ich they have interacted over time. 
Accordingly, for the reader who wishes to determine 
quickly what each of the five volumes in the series contains, 
turn to the inside of the back cover of the volume; for the 
reader who wishes to understand how the volumes relate io 
one anothe.*, follow that by reading Volume I. 
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ABSTRACT 



Tliis is one of five volumes reporting the results of the Oregon 
Studies in educational research, development, diffusion, and evaluation 
(educational RDD&E) . It contains 20 case study profiles of educational 
RDD&E projects, and as such constitutes the data base for the Oregon 
Studies. The Volume is bound in Three parts. Part One contains profiles 
of five research and three evaluation projects; Part Two contains profiles 
of seven development projects; and Part Three contains profiles of five 
diffusion projects. Each part within the volume contains information 
that describes the development of the profiles, how to read the profiles,, 
and a glossary of common profile terms. Each profile contains three 
sets of data: 00 descriptors of general project characteristics, e.g., 

objectives, timelines, organizational structures, and project ’'dynamics;' 1 
(b) descriptors of personnel working within projects, including back- 
ground of training, work experience, and job role definition; and (jc) 
descriptors of the work requirements within a project. Work requirement 
data include descriptions of the outputs that derive from a project, the 
standards held for those outputs, the operations required to produce 
outputs to the standards specified, and the knowledges , skills , and 
sensitivities drawn upon to carry out project operations. Nine hundred 
and sixty-two outputs of work effort were identified in the 20 projects. 
Two hundred and ninety-eight of these were analyzed for their work 
requirements. From this analysis 1148 descriptions of standards, 

3722 descriptions of tasks, and 2974 descriptions of knowledges, skills, 
and sensitivities were obtained. One hundred and thirty-feur pro- 
fessional persons were interviewed in collecting these data. The profiles 
are discussed in the preface to the volume from the point of view of 
their utility as scientific and training documents. 



PREFACE 



Thu present volumt 1 contains (inscriptive profiles of 20 educational 
research, deve 1 opmen t , diffusion, and evaluation (educational RDD&E) 
projects. The volume Is bound In three parts. Part One contains pro- 
files of 3 research and 3 evaluation projects; Part Two contains profiles 
of 7 development projects; and Part Three contains profiles of 3 dif- 
fusion projects. In addition, each part within the volume contains 
information that describes the development of the profiles, information 
that serves as a guide to reading the profiles, and a glossary of common 
profile terms. In combination, these materials should permit a reader 
to study the profiles with sensibility and understanding . 

Each profile attempts to portray tne essential characteristics of 
the. project it describes and the realities wf work requirements within 
it. Toward these ends, each profile describes: (a) the general charac- 

teristics of a project, u.g., objectives, timelines, organizational 
structures, and project "dynamics;" (b) the characteristics of personnel 
working within a project, including background of training, work experi- 
ence, and job role definitions; and (c) the work requirements within a 
project . 

The central data reported in a profile deals with project work 
requirements. In this regard, each profile describes the outputs of 
work effort, the s tandards established for those outputs, the operations 
required to produce outputs to specified standards, and the knowledges , 
ski 1 Is , and sensitivit ies needed to carry out those operations. An over- 
view of the data sets used to describe these variables and their inter- 
dependencies is provided in the reader’s guide to the profiles. The 
rationale for and a full description of the data sets used is proviced 
in Chapter 4 of Volume I of the series of volumes reporting the Oregon 
Studies . 

The profiles were designed to serve the purposes of both science 
and training. In support of science the profiles serve three functions: 
(a) the careful description of phenomena of interest; (])) the develop- 
ment of a methodology by which to carry out such description; and 
(c) the development of a data base that permits parameter identification 
and comparative analyses. In support of training the profiles serve 
two functions: (a) they provide a means of gaining insight into the 

nature of and work requirements within individual educational RDD&E 
projects; and (b) they provide a means of gaining insight into the 
nature of and work requirements within the domain of educational RDD&E 
as a whole. Because these various concerns have combined to make the 
profiles as they are, each will be discussed briefly. 

PROFILES AS BASIC SCIENCE DESCRIPTIONS. Individually and collec- 
tively the profiles provide accurate, reliable, and relatively exhaus- 
tive descriptions of ongoing RDD&E activities at the project level. 

All projects described ar<^ il lustrat ive of the kinds of RDD&E activities 
likely to be funded in the decade ahead. The rationale for obtaining 
such descriptions involved a series of related propositions: (a) research, 

development, diffusion, and evaluation activities have served as powerful 
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The rationale for reporting sura descriptions in case profile lorm.it was 
less complex r It invited a more detailed description of project charac- 
teristics and activities than might otherwise he provided. This was 
assumed to he true for both the identification of the variables to fie 
attended to in describing projects and Uic exploration of the inter- 
actions of those variables. 

^K01\id:s AS MKTIIOUOLOCICAL PRO /ING GROLNL . The decision to describe 
educational RDD&K projects in case profile terms required that a method- 
ology be developed Inal would generate ”c isr study'* data. The develop- 
ment of a,Uwii a methodology became a primary focus of the Oregon Studies, 
and the preparation of profiles was, to a large extent, a natural culmina- 
tion of that focus. Two assumptions accompanied the emphasis on method- 
ological development: («i) t lie Oregon Studies represented the first in 

a series of empirical studies to be undertaken on the nature of educa- 
tional RDD&K; and (10 greater benefits would accrue to education over 
the long term by directing limited resources to the development of strong 
methodology than would accrue had the investment of resources been directed 
to the collection of large amounts of data with a weaker methodology. 

As a proving ground for me thodology , the profiles provided a basis 
tor* making two kinds of judgments: (a_) judgment as to the sophistication 

of llu» methodology, i.e., the extent to which the methodology generates 
accurate, reliable, and reasonably exhaustive descriptions of educational 
itUD&H activities; and {b) judgment as to the robustness of the methodology, 
i.e., the extent to which the methodology can be applied to widely 
varying projects with equally productive results. Lvi donee as to 
sophistication was obtained by submitting completed profiles of projects 
to the directors of those project^ for review and approval. In a 1 ! cases 
the profiles met the criteria of sophistication outlined above (see the 
Notes on the Development of the Profiles for project director evaluations). 
Evidence as to robustness was obtained by applying, the methodology to 
the 20 projects described in the present volume. These projects varied 
widely, and it was assumed that if the methodology was indeed adequate 
in terms of its robustness each of the 20 projects could be described with 
equal facility. It was also assumed that the data generated in relation 
to each project would be roughly comparable. As will be seen upon reading 
the profiles, those criteria have been met. An overview of the method- 
ology is provided in the reader's Guide to the profiles. A detailed 
description of the methodology, as well as a description of the manner 
in which it evolved, is provided in Volume V of the series of volumes 
reporting the Oregon Studies. 
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PROF I LKS AS A DAiA MASK FOR PARAMETER IDI.N'I I FI CA I i '>N AND COMP AKA FI Vi’, 
ANALYSES . flu* decision to view the prof lies as a data base for fdciiJ living 
nr "mapping" the parameters of tne domain of educal Iona l RDD&E emer ged as 
«i logical extension ot the two previously discussed prof lie functions. 

Since extensive- descriptive data on the nature of educational ROOM! were 
to be made available as a result of profile development, and since profiles 
were to be prepared for widely varying projects to test the robustness of 
a methodology, the selection of the projects to he described was approached 
from the point ol view that they represent a sample of the projects that 
exist within the domain of educational RDD&F. as a whole. Given the small 
number of projects that could be described in case ctudy form with the 
resource base available, and given the variability that was to be reflected 
in those projects, no illusions were held about the representativeness 
of the sample that could he drawn, At the same time, it was reasoned 
that if the projects to he described sampled at all well the variability 
that existed in projects within the domain, the descriptions of those 
projects would provide at least a beginning base for sketching an "outline 
map" of the parameters of the domain As an outgrowth of this kind of 
reasoning, it was decided that projects should vary systematically with 
respect to major sources of variability in educational RDD&E projects as 
a whole. Accordingly, the 20 projects described vary as to focus (research, 
development, diffusion, and evaluation), size (a funding base of less than 
$100,000 per annum, between $100,000 and $250,000 per annum, and over 
$250,000 per annum;, and setting (public schools and state departments 
of education, colleges and universities, publicly funded laboratories 
and R&D centers, and privately funded R&D centers). A description of 
the procedures followed and criteria used in selecting the 20 projects 
is provided in Chapter 3 of Volume 1 of the series of volumes reporting 
the Oregon Studies. 

As a data base for mapping the domain of educational RDD&E , the 
profiles actually serve two functions: (a) they provide a basis for 

mapping the parameters of the domain; and (b) they provide a basis for 
mapping the commonalities or central tendencies of the domain. As a 
basis for parameter mapping the profiles constitute an excellent source 
of data. Even though the project sample is small, and the absolute data 
base on which to prepare maps limited, projects have been selected so 
as to insure that they are reasonably representative of the range of 
projects to be found within the domain of educational RDD&E. Thus, the 
range of personnel employed in the 20 projects described > the range of 
project strategics followed, the range of organizational structures used, 
the range of outputs produced, the range of tasks performed, the range of 
standards held, and the range of knowledges, skills, and sensitivities 
drawn upon in their execution can be assumed to be reasonably representa- 
tive of the range of such things to be found within the domain as a whole* 

The technical appendices that accompany Volume I of the series of volumes 
reporting the Studies summarize these data. 

Given the sampling strategy that was followed, it is obvious that 
the profiles constitute a much weaker data base for mapping commonalities 
or centraL tendencies. Clearly, the sample was drawn to highlight the 
parameters of the domain rather than its central tendencies. Nevertheless, 
the data are amenable to central tendency analyses, and they were under- 
taken. The "outline maps" presented in Chapters h, 7, and 8 of Volume I 
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i 'mil that work, tlie knowledges, skills, and sensitivities needed to 
r ur/ it out, the interpersonal and interagency dynamics involved in 
pi o j im: l operation, etc# Sucli ini or mac i on should be of value to students 
preparing to enter the field of educational Ri)i)&F, stall who have just 
entered the t i *.* J d , or project directors who need to provide in the job 
f i n ini ng. 



PK'iFlLKS A.d) CROSS PROF ILK ANALYSES AS A BASIS FOR TRAibJNC PKOUKAM 
1JCS I By treating each of the 20 profiles ns reliable descriptions of 
"what Lite is like" within the context of educational UDO&K projects, 
oy treating the summatod data as a trustworthy description of the range 
o’’ project activities within the domain as a whole, and by having at 
hand whatever central tendency data that can be gleaned from the compar- 
ative analyses o 4 ‘ projects, the designer of training programs should be 
in a position to make reasonably informed decisions as to what the focus 
and content of those programs should he. In combination these data begin 
to provide the designers of training programs with a sense of the arena 
within which educational KDD&K personnel must function, and with a sense of what 
uas to be done to function effectively within that arena. Chapter 14 of 
Volume 1 of the series of volumes reporting the Oregon Studies speLls 
out some of the implications that derive from these various data sources 
for the design of training programs. 

A wide range of persons have been involved in the preparation of 
the profiles. In fact, nearly ail persons involved in the Oregon Studies 
have contriouteu in one way or another, for essentially all activities 
undertaken within the studies have pointed towards profiLe production. 

Since other volumes detail the activities that have been related to 
profile development, e g. , the development of the methodology used to 
collect the data reported in the profiles (Volume V) and the develop- 
ment of the conceptual framework that guided the methodology (Volume 
HI), the persons involved most directly In those activities need not 
be recognized here. Those who have been most directly involved in 
profile preparation do, however, and the purpose of the following 
paragraphs is to make that recognition public. 

it is proper to acknowledge first those persons in the U.S. Office 
of education who had the wisdom and courage to insist upon the develop- 
ment of case profiles, and their accompanying methodology, as the 
primary outputs of the Oregon Studies. In this regard the efforts of 
Ms. Cora Beebe and Drs. John Egermeier, Sue Klein, and Paul Messier 
deserve special recognition. So do the efforts of Dr. John Hopkins 
of Indiana University, the U.S. Office of Education's special consultant 
to the project. The contributions of these five people to the design 
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.i rif I I mp 1 erne" t.i l i on ni the . ase profiles am! Liu* supporting method*) logy 
have been nj I ncs l 1 m.ih 1 r value. Also deserving of recognition is the 
role played in tin? project bv HSOI. project; officers. Their willingness 
to review projects to help in identifying those that appeared to meet 
the criteria for inclusion in the Oregon Studies was clearly beyond 
their established duties* My thanks to all in FSOC who have given 
so much, 

I wish to express ;ny thanks also to the directors of the various 
projects lor which case profiles were prepared, and to their staffs, 
ft Is not easy to give up as much as three days of time when conducting 
a major KJ)U or C project, or to release major staff members for as much 
as a day or a day and a half to do other than project work. Participa- 
tion in the Oregon Studies represented a sizeable Investment of these 
people's time and nergy, and I wish to express my deepest appreciation 
for their willingness to make such an investment. 

Finally, I wish to express my thanks to the staff or the Oregon 
Studies who were responsible for data collection, reduction, and profile 
preparation. Since so many have been involved, and in so many different 
ways, I will simply list names by activity. finis, the task of refining 
tlie criteria for project selection, identifying projects tiiat met those 
criteria, and making initial contact with tiiose projects relative to 
part icipat ion in the study: the team of dr. Steve Anderson, Mr. Parrel 1 

Flukey, Ur. Dale llamreus, and Ur. Jim Nord; the task of making site visits 
for purposes of final project selection: the team of Ur. Harry Ammcrman, 

Dr. Dale llamreus, and Mr. Greg Thomas; t lie task of data collection, 
reduction, and initial profile preparation: Mr. boring Carl, Mr. Norman 

Crowliurst, Mrs. Leu Green, Mr. Herb Hill, Mrs. Diane Jones, Ur. Rod Myers, 
Ur. Jim Nord, Mr. Dean Pielstick, Mr. Clark Smith, and Mr. Greg Thomas; 
the task of profile editing and refinement: Ur. Harry Ammerman, Mr. 

Coring Carl, Mr. Darrell Clukey, Dr. Kevin .Morse, and Mr. Greg Thomas; 
the task of coordinating and scheduling the interview teams: Mr. Greg 

Thomas; the task of interview team training, and tlie task of administer- 
ing quality control checks on all data reduction: Mr* Coring Carl and 

Mr. Clark Smith; tlie task of tracking all data from the time it came in 
from tlie interview teams until it was organized and presented within 
a completed case profile, including the task of editing each profile 
to assure consistency and quality; Mr. Darrell Clukey; the task of 
transferring the reduced data to computer storage, tlie preparation of 
computer programs for tlie analysis of the data, and the execution of 
those analyses: Mr. Will Hickok; the task of overall activity 

coordination: Dr. Harry Ammerman. 

My deepest thanks to all for tasks well done. 



H. Del Schalock 

Director of the Oregon Studies 
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— PART TWO -- 
DEVELOPMENT PROJECTS 
(separately bound) 

Tri-Hnlversity Project on Behavioral Objectives in English Grades 9-12 
Clark A. Smith 

Proving Wide Ranging Diversely Organized Pools of Instructional Objectives 
and Measures 

Norman H. Crowhurst 

Relevant Educational Application of Coi uter Technology 
Lee Green and Loring M. Carl 

The Integrated Career Development Curriculum 
R . E, Myers 

Development of a Multimedia Course in Leadership for the U,S. Naval Academy 
Norman H. Crowhurst 

Study and Development of Automated Instruc tional-Mater ials-Handling Program 
Herbert E. Hill 



NOTES ON THE DEVELOPMENT OF THE PROFILES 



Fourteen specifications guided the development of the profiles that 
appear ip the present volume. Seven of the 14 pertained to the content 
of the profiles. ~ ~~ 

1. They were to accommodate widely varying data within a standard 
format, that is, a single format was to accommodate data 
emerging from an "evolving 1 ' case study methodology that was to 
be applied to projects of widely varying characteristics; 

2. They were to convey both the ’'essential” features of a project 
(as opposed to every possible feature), and the ’’realities” 

of work within it; 

3. They were to include a description of the conte 3 :t within which 
a project was operating; 

4. They were to include both, but discriminate between, sub- 
jectively and objectively derived data; 

5. They were to include the ’’raw” data from which categorized 
data emerged; 

6. They were to highlight the training implications that emerged 
from the study of a particular project; and 

7. They were to avoid description of the substantive content of 
a project, except as needed to understand a project within 
the context of the profile. 

Four specifications pertained to the form of the profiles: 

1. They were to preserve the anonymity of persons within projects; 

2. They were to be candidly written, but without evaluative 
overtones and without reference to outside standards for 
comparative purposes; 

3. To the extent possible, each profile was to make a unique 
contribution to the set of profiles (thus allowing indi- 
vidual differences between profiles with respect to degree 
of emphasis on various classes of data, depth of detail, 
etc.); and 

4. They were to be readable and understandable by persons just 
entering the field. 

Three specifications pertained to the means by which the profiles were 
prepared : 



1. Thu profile design, and me Linkage oi that design to data, 

was tr) l)e such that persons relatively unskilled in pro f ess I ona J 
report writing could, without elaborate training, assemble 
and prepare a profile; 

2 . Profiles were t:c he prepared and made available for review 
and/or use as suoa as possible after the analysis of a 
project had neon completed; and 

1. Profiles were to be approved before publication by the directors 
of the projects described. 

In sum the task of the Oregon Studies was to develop a procedure 4 and 
a format for writing profiles that would display widely differing kinds 
of data from widely differing projects in a manner that would be easily 
understood, and that would allow for comparability acro.;s projects while 
retaining the ability to present characteristics idiosyncratic to indi- 
vidual projects. Furthermore the procedure and format were to accomodate 
the variability introduced in data by an u evolving ,r methodology, and were' 
to be able to be applied by persons with little or no experience in formal 
report writing. The profiles reported in the volume meet or have met 
these specifications. 

Procedurally , profile design progressed through six identifiable 
stages, The first stage occurred prior to data collection activities, 
and involved the outlining of alternative profile formats for anticipated 
data. These were prepared for conference review in coniunction with the 
first review of the proposed methodology (July 197 j), In the second 
stage of development, alternative profile formats were prepared for a 
single project using trial data collected on that project. These were 
prepared for conference review in conjunction with the second review 
of the methodology (October 1970), It was through these two external 
review conferences that most of the specifications relative to the 
development of the profiles emerged. 

The third stage in the evolution of the profiles involved the 
development of a format that accommodated both the specifications that 
had been developed, and the data that were by then emerging from application 
of the methodology. Four profiles were prepared according to this format, 
and submitted for conference review in conjunction with the third external 
review of the methodology. This was held in March 1971, and constituted 
the last formal review of the profile format. In all three of the 
external review sessions, participants included the consultants to the 
Oregon Studies, training program directors, U.S. Office of Education 
personnel, and the authors of the conceptual papers that appear in Volume 
III of the series of volumes reporting the Oregon Studies, 

Following the March review, the profile format went through three 
additional "fine tuning’ 1 stages in its development. The first of these 
(Stage 4 in the development of the profile formats) incorporated both 
the recommendations received at the March conference and the subtle 
shifts that occurred in data collection strategy following that conference. 
Six profiles were prepared using this particular format. The next to last 
refinement in format (Stage 5) reflected the final refinement in data 



collection methodology, and was used In describing the remaining 1U 
projects analyzed. The final refinement in format (Stage 6) involved an 
internal review of the total set of profiles from the point of view of 
standardizing terminology, table headings, and caLegory labels. 

Because of the evolution of data collection methodology and profile 
format during the course of the Oregon Studies, it was not possible to 
achieve complete standardization across profiles. The first four profiles 
prepared contained data that were sufficiently different from the data 
reported in the. next six, and the data reported in those six were suf- 
ficiently different from that reported in the last 10, that differences 
between the three sets could nul be eliminated by the final refinement 
effort. As a consequence, the total collection of profiles reflect 
three recognizably different formats, as well as three slightly different 
data sets. All profiles contain the same basic chapter organization, 
however, and the same major headings within chapters, so differences 
between profile sets are minimal. The GUIDE TO READING THE PROFILES 
has been designed both to introduce the reader to the substantive content 
and organization of the profiles, and to place the differences in profile 
format in perspective. Chapter 4 of Volume I of the series of volumes 
reporting the Oregon Studios traces the implications of profile format 
differences for cross-project analyses. 

A number of procedures were adopted as guides to the preparation 
of profiles. Profile writers were always members of the data collection 
team and they always knew in advance when they were to serve as writers. 

To insure consistency across writers, chapter titles, major headings 
within chapters, data tables and figures, and data sources were standard- 
ized. During the actual process of preparing the profiles, writers were 
instructed to make use of all record forms, tape recorded interviews, 
and data presentations. Debriefing sessions conducted with the members 
of the data collection team were held to further the writer’s under- 
standing of both the project as a whole and the data collected in rela- 
tion to it. 

Profile drafts were given substantive critiques by all members of 
the data collection team, and editorial critiques by at least two other 
Oregon Studies staff. Where extensive revisions were needed, the 
revised drafts were subjected a second time to a complete review and 
critique process. Upon completion, each profile was submitted for 
review and approval to the responsible officer of the project being 
described. The last five profiles submitted to project officers were 
accompanied by a profile rating sheet in order to obtain specific infor- 
mation as to their adequacy. The results of these ratings are summarized 
in Table 1. 
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Focus of rating 



Hat ing Schedule 
A I B C 



1. Description of organizational structure 

2. Description of organizational operations, 
interrelationships 

3. Description of the ends bein^ sought by 
the project 

A. Representativeness of all ou puts indexed 
(Ch. IT) 

5. Representativeness of the outputs analyzed 
(Ch. Ill) 

6. Accuracy of the data presented on outputs 
(Appendix) 

7. Overall representativeness of the Profile 
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Rating Schedule 

Check box A, B, or C as follows: 

A = Representative of a majority of operational concerns. 

B = Representative of only a part of operational concerns 
(concerns of significant proportions omitted). 

C = Major concerns not covered. 
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A omul; to reading the profiles 



Since the profiles are relatively complex documents, and since 
they vary in format (see NOTES on the development of the profiles), a 
guide to their reading lias been prepared. The guide is designed to 
orient the reader to (a) the classes of data reported in the profiles, 
(_b) the procedures followed in collecting those data, (c_) the trust- 
worthiness of those data, and (d_) the manner in which the data have 
been organized within the profiles. tf used in conjunction with the 
NOTES on the development of the profiles and the GLOSSARY of profile 
terms that also appear in the volume, a reader should have no dif- 
ficulty in making his way through the profiles. 



Classes of Data Reported in the Profiles 

As indicated in the preface to the volume, three major classes of 
data are reported in each profile: (a_) descriptors of general project 
characteristics; (b) descriptors of project personnel; and (c_) descrip- 
tors of project work, requirements. Work requirement data are reported 
both in terms of worn, activities associated with job roles and work 
requirements associated with project outputs. The data sets that 
comprise these various data classes are described briefly in the para- 
graphs that follow. The rationale for and full description of the data 
sets appear in Chapter 4 of Volume I of the eries of volumes reporting 
the Oregon Studies. 

D ata Sets Used in Describing the 
Genera l Characteristics of Projects 

Five data sets are used to describe the characteristics of a 
project as a whole: (a_) the objectives of, rationale for, and contribu- 

tions to be made by a project; (b) the timelines established for complet- 
ing work within a project; (c) the organizational structure within which 
the work of a project is carried out; (cO the political-institutional- 
intellectual context within which a project rests; and (e) the ,f dynamics M 
of project operation. The first three data sets are self-explanatory. 
Context data pertain to the relationship of the project being studied 
to its sister projects, to the activities of the administrative unit 
within which it rests, and to the broader political-institutional context 
within which it rests. These relationships are portrayed in the form 
of a "context map." 

As used in the Oregon Studies, "project dynamics" is a catch-all 
term that involves information pertaining to procedures, feelings, 
patterns of behavior, or anything else that can be used to convey a 
sense of either the "essence" of or the "reality" of working within a 
particular project. The focus of that which is reported may be project 
operations, factors influencing project operations, and/or the 
consequences of project operations. Operationally, the data pertaining 






t pin jet t. dynamics involves the pooled perceptions, ohserva t ions , 
hunches, and insights gained by the staff of the Oregon Studies during 
the three to five day on-site visit required for project analysis. 

ho formal category sots have been developed for coding any of these 
data. A 1 J are reported in the form of narrative statements within the 
context of the case profiles. 



Data_ Sets Used in D escrib - 
ijn. g P roject . Personne l 

’hre.e data sets are employed in describing project personnel: (a) 

tile background of training and work experience of professional staff; 

(b) a description of the job or jobs held by professional staff; and 

(c) the support services and resources available to staff in the perform- 
ance of their respective job roles. All of t lie data within these sets 
are reported in terms of questionnaire items. 



D ata Sets Used in Describing Work 
Activities Associated With Job Roles 



Two data sets are employed in describing work requirements associated 
with job role: (a) the perceived requirements associated with a particular 

job held; and (b) die emphasis given lO various classes of work activities 
within the context of a particular job held. These data are also reported 
in terms of questionnaire items. 



Data Sets Us ed in Describing Wo r k Requirements 
Associated With the Producti on of Project Outpu ts 

lour data sets are employed in describing work requirements associated 
with the production of project outputs: (a) the outputs of work effort 

per se; (jj) the standards held for those outputs; (c) the operations 
required to produce specified outputs to specified standards; and (d_) 
the knowledges, skills, and sensitivities required to carry out those 
operations. These are the primary data sets reported in the profiles, 
and as such they are far more complex and extensive than the other 
data sets reported. 

In attempting to describe the outputs of projects, and the standards, 
operations, and enablers that relate to them, it was necessary to establish 
a number of category sets to handle the complexity that was found. Two 
approaches were taken to the development of these sets: ( a ) a conceptual- 
empirical (deductive) approach; and (lb) an empirical-conceptual (inductive) 
approach. In the former, category sets were developed as an extension 
of the conceptual framework that guided the Studies in the latter, they 



^ For a description of the conceptual framework that guided the empirical 
thrust of the Oregon Studies see Schalock, H.D. and Sell, G.R. , "A Frame- 
work for the Analysis and Empirical Investigation of Educational RDD&E," in 
Chapter A of Volume III of the series of volumes reporting the Oregon Studies. 



were developed in response t j the data emerging from the study of ongoing 
projects. ^ Opernt ionally , however, the two approaches were complementary, 
for the conceptual-empirical approach yielded category sets that functioned 
as relatively broad, general organizers of the data, and the empirical- 
conceptual approach yielded category sets that functioned at a "close to 
the source," descriptive level. Figure 1 provides a summary of the concep- 
tually derived sets used to organize information about project outputs, 
standards, operations, and enablers. Figure 2 provides a summary of the 



STRUCTURE 



FUNCTION 



CHARACTER 



LEVEL 



OUTPUTS STANDARDS OPERATIONS ENABLERS 



Products Output Knowledge 

Events Process Skill 

Conditions Sensitivity 

Policy Setting 
Management 

Production __ 

Knowledge 

Technology 

Implementation 

Information 

Focal Activities 

Component Tasks* 

Facilitating Actions 



FIG. 1. Category sets used to describe at a broad, conceptual 
level the properties of outputs, standards, operations, and enablers. 

*0f this set, only task level descriptions were obtained. Time 
and resources did not permit an analysis of operations at the 
level of actions, and the activities set was left to be derived 
empirically . 



empirically derived category sets used to organize the same information, 
that is, statements describing work requirements in the language of persons 
working in the field. The various primary and cluster categories that 
make up these sets, as well as the procedures followed in their develop- 
ment, are described in Chapter 4 of Vol. I of the series reporting the 
Oregon Studies. The number of data statements (interviewee statements) 
classified within these various category sets include 1148 that are 



^To some extent this is an over simplification, for the conceptually 
derived categories were tested empirically in the course of their 
derivation, and the empirically derived categories were always influenced 
bv conceptual considerations. (See Chapter 2 in Volume I of the series 
of volumes reporting the Oregon Studies, or Volume V, for a discussion 
of the procedures followed in the development of the methodology.) 
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tlcHcr Ipt Lvo o[ output standards, 3722 that are descriptive of output 
related tasks, and 2497 that are descriptive of output related enablers. 



OUTPUTS OUTPUTS 

IDENTIFIED ANALYZED STANDARDS TASKS ENABLERS 



Number of PRIMARY 
Categories Used to 
Classify Inter- 
viewee Statements 



167 



79 280 136 



Number of CLUSTER 
Categories Used to 

Classify Primary ^ 46 

Categories 



FIG. 2. Category sets used to describe at a n close to the 
source,*' empirically derived level the properties of outputs, 
standards, tasks, and enablers. 



The Interdependence of Data Sets 

As indicated in the preface, each case profile was to describe not 
only the variables listed in the preceding paragraphs, but their inter- 
dependencies as well. This in turn required that a way be found to 
collect data on those interdependencies. Accordingly, a schema was de- 
veloped which placed the full set of variables within the context of an 
interacting whole. Within this context OUTPUTS were adopted as central, 
that is, all other data sets were linked to them. Procedurally, this 
required that outputs of work effort within a project be identified, a 
set of these be selected for analysis, and for each output analyzed 
establishing the STANDARDS set for its production, the OPERATIONS re- 
quired for its production, the ENABLING KNOWLEDGES, SKILLS, and SENSI- 
TIVITIES needed for its production, the PERSONS involved in its 
production, and the RELATIONSHIP of that output to the other outputs 
involved in the work of a project as a whole. It was also possible to 
link a particular output to the organizational structure of a project, 
the context within which the project rested, and even the "dynamics" 
of a project, though not so directly as in the case of variables that 
depended upon output linkage for their definition. The interaction of 
these various classes of data is illustrated schematically in Figure 3. 
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FIG. 3. Classes of information sought in describing a project, 
and their relationship to outputs of work effort. 
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Procedures Followed in Data Collection 



Three relatively distinct procedures were employed In collecting 
the data reported in the profiles. hy and Large these corresponded 
with the three major classes of data collected. All data, however, 
were collected v/ithin the context of an "on-sito" visit by a data 
collection team from the Oregon Studies. Depending upon the size and 
complexity of a project, teams consisted of from two to six people, 
and the length of the site visit extended from three to five days. 

An overview of the procedures used in collecting the various classes 
of data reported in the profiles is provided in the paragraphs that 
follow. Additional detail is provided in Chapter 4 of Volume I, and in 
Volume V, of the series of volumes reporting the Oregon Studies. 

General Project Descriptors 

Probably the best label for the procedures used in collecting 
data on general project descriptors is that of "non-obt rusive . The 
objectives of a project, the rationale for a project, project time 
lines, organizational structures, and the like, were obtained from 
project proposals and other documents descriptive of the project. 

Also, information on the "dynamics' 1 of the projects were gathered 
through incidental observation, the recall of casual comments made 
by project staff while being interviewed, and the "hunches" or 
"insights" gained while working with project data. Almost without 
exception these sets of data were able to be collected without in- 
trusion upon people's time and energy. 

The one data set used to describe the general characteristics 
of projects that was intrusive was the data set that described the con- 
text within which the project rested. Some information of this kind 
was usually able to be gained from proposals and other documents, but 
in all cases project directors were interviewed when developing a 
context map. In some instances this amounted to little more than 
confirmation of information gained elsewhere, but in others it in- 
volved both the generation and piecing together of information about 
intra- and inter-institutional linkages that were simply not made 
explicit in existing materials. Generally speaking, the larger the 
project the more complex its political-institutional-intellectual 
linkages, and in some cases, for example the Children's Television 
Workshop, the development of a map to depict these linkages was a 
major undertaking. 

Personnel and Work Activity Descriptors 

All of the data that describe the personnel associated with a 
project, and all of the data that describe work activities associated 
with job roles, were collected through questionnaires. These were 
administered by members of the Oregon Studies staff, either while 
visiting the project site or through telephone. Three questionnaires 
were involved: (a) a general project questionnaire; ( b ) a job/ task 

inventory; and (£) a general activities questionnaire. The data 
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reported trom the three questionnaires are referred to in the profiles 
js form 02, 03, and 04 data respectively. Copies of the three question- 
naires may he found in Volume V of the series of volumes reporting the 
Oregon Studies. 

Output and Work Requirement Descriptors 

All data on outputs and work related to their production were col- 
lected through interview. The interview strategy called for: (a) 

identifying outputs associated with a project (an output index); (b ) 
ordering those outputs according to their interdependencies (an output 
map); (c) selecting from the map those outputs for which work require- 
ment data were to be obtained; (d ) identifying persons most directly 
responsible for and/or most directly involved in the production of those 
outputs; and (e) interviewing those persons in relation to the standards 
held for the output being analyzed, the tasks required to produce the 
output, and the knowledges, skills, and sensitivities needed to perform 
the required tasks. The selection of outputs to be analyzed was done by 
the data collection team, on site, after an output map had been estab- 
lished and a sense had been gained as to the outputs that were most 
critical to the project. Persons interviewed provided information 
relative to his or her own contribution to the production of a particular 
output, as well as the contributions of others (a distinction between 
self-other data was maintained throughout the project.) As familiarity 
with a project grew, adjustments were made as needed in the output map, 
the selection of outputs to be interviewed around, and the matching 
of interviewees with outputs. All interviews were tape recorded, and 
all data were reduced from the recordings by the person who did the 
interviewing . 

The reduction of the interview data involved a multistep process: 

(a) editing tapes to identify data statements within them, that is, 
statements pertaining to standards, tasks, and enablers; (b) the recapi- 
tulation, or "recapping", of data statements into a readable, gram- 
matically correct form, that is, independent clauses and/or sentences 
(care was taken not to destroy the original language of the interviewees 
in this process); (c) the transfer of the recapped statements to color- 
coded summary sheets that corresponded to the various data sets being 
used; (d) the coding of the recapped statements by a two person coding 
resolution team (during this process the coding team was free to call 
upon members of the data collection team for statement clarification, 
interpretation, context building, etc.); and (ej the storage of the 
coded data in computer files in a way that permitted the interdependencies 
within the data to be maintained. A record of all steps in the data 
collection and reduction process was maintained from the time of first 
contact with a project until all data on that project had been computer 
stored and verified. 
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The* Trustworthiness ot the* Data 



Since tlie classes of data reported in the profiles were collected 
by various means, each must be considered separately as to its trust- 
worthiness. Accordingly, the potential sources of error that reside 
within each data class, and the steps taken to control them, are reviewed 
in the paragraphs that follow. 

General Project Descriptors 

Four of the five data sets used to describe the general character- 
istics of projects mad''* use of working documents. These included project 
objectives, timelines, organizational structures, and context maps. 
Typically, the document used had been prepared by project directors. 

To the extent that such documents can be accepted at face value, and 
to the extent that the Oregon Studies staff did not introduce error in 
reporting the substance of those documents, the data sets that made use 
of them were subject to few sources of error. As a consequence, no 
formal measures of trustworthiness were prepared for them. 

Judgments relative to the trustworthiness of the data reported on 
project dynamics is another matter. It will be recalled that these data 
consist of the pooled observations, hunches, ’’insights,” and choice tid- 
bits of information gleaned by members of the data collection team from 
a wide variety of sources. It will also be recalled that these data 
intentionally were to be subjective and impressionistic. As a ir°ans of re- 
ducing gross error all final descriptions of the dynamics of projects 
were read and confirmed by all members of the data collection team that 
visited a project, but no formal measures as to the trustworthiness of 
such data were obtained. For purposes of profile presentation, however, 
the data on project dynamics are reported. 

Personnel and Wortc Activity Descriptors 

Since the data sets describing personnel and work activities were 
derived through questionnaire methodology they were subject to all the 
sources of error known to operate within that methodology, for example 
the error that is introduced through the selection of questions asked, 
the possibility of multiple interpretations of those questions, and the 
lack of opportunity to determine falsification or shoddiness of response 
to the questions. The steps taken to control these sources of error were 
of two kinds: (a) reasonable care in the development and testing of the 

questionnaires prior to their utilization for purposes of data collection; 
and Cb) the administration of the questionnaires while the data collection 
team was on site. The first step involved a number of field trials of 
the questionnaires, and a number of revisions in them on the basis of 
those trials. The second allowed the questionnaires to be introduced 
within the context of the data collection effort as a whole, and within 
that context an opportunity to clarify troublesome questions about or 
within them. In combination, it is believed that these procedures 
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Huf C lcicnt Ly reduced the typical sources of error that enter the collec- 
tion of questionnaire data that the data reported can be viewed with a 
fair degree of confidence. 

Output and Work Requirement Descriptors 

Just as the personnel and work activity data were subject to the 
error typically associated with use of questionnaires, the output and 
work requirement data, since it was collected through interviews, were 
subject to tlie error typically associated with interviews. Four sources 
of error have always been troublesome in this regard: (a_) the selection 

of interviewees as data sources; (b.) the information elicited from inter- 
viewees about work requ * i aments ; (c_) the coding of the information 
obtained from interviewees; and (cO the storage, retrieval, and analysis 
procedures used in mani t fating the coded data.d The procedures followed 
in the Oregon Studies to combat these sources of error are summarized in 
Table l. Given the procedures followed, and the coding reliability 
obtained, It seems reasonable to view the output and work requirement 
data with a good deal c f confidence. 



FroMle Organization 



It will be recalled from reading t he NOTES on the development of 
the profiles that three variations in profile format will be found in 
the present volume. These correspond to variations in the nature of the 
data collected at various points in the Studies, and represent one of 
the less fortunate consequences of the decision to emphasize methodo- 
logical development (see Preface). Although the differences in the data 
presented in the three profile formats are not great they can be con- 
fusing to a reader when first encountered. The purpose of this section 
of the GUIDE is to introduce the reader to the general organization of 
the profiles, and tc spell out how the two earlier profile formats (Formats 
1 and 2) differ from the final format (Format 3). 



3 When the profiles are being considered as a data base for cross-project 
analyses, other sources of error must be considered. Two critical 
sources are (a) the adequacy of the sample of projects drawn and (b ) the 
adequacy of the sample of outputs selected for analysis within a given 
project. These are sources of error that relate to the generalizability 
of data, however, and are not of primary concern in considering the case 
profiles as descriptions of individual projects. 
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TABLE i 



Procedures Followed in Controlling Sources oi Error 
In Output-Work Requirement Data 







source of error 


PROCEDURES FOLLOWED TO REDUCE ERROR 



Interviewee Only staff intimately acquainted with or involved in 

Selection the production of an output were selected for inter- 

view, The relationship of the interviewee to an 
output was always confirmed by the project director, tire person to be 
interviewed, and the immediate supervisor of thai person. Data re- 
ported by an interviewee on the work of others in relation to an out- 
put were noted and coded separately. 

Data Generation A structured interview procedure was used to obtain 

data on the standards, tasks, and enablers associated 
with a particular output. In the interview, standards were the first 
to be identified, followed by the tasks engaged in to produce the out- 
put to those standards, followed by the knowledges, skills, and sensi- 
tivities .drawn upon in carrying out the tasks identified. Stylistic 
variations in interviewing were permitted uo as to accommodate either 
interviewer or interviewee differences, but during the course of an 
interview all data sets were exhausted. (For a detailed discussion 
of interview procedures see Volume V of the series of volumes report- 
ing the Oregon Studies). 

Data Reduction A carefully established set of procedures and 

decision rules were followed in "recapping" the 
interviewee statements, and in coding the recapped statements in 
terms of appropriate data sets. The recapped statements were first 
checked for their coinple ?ness and adequacy by the data coordinator 
upon the return of the data collection team from a project site. 

They were checked again by the coding team. Incompleteness, or 
error, or lack of clarity detected on either of these checks required 
that the recapped statements be revised until they were acceptable 
at both quality assurance checkpoints. To insure reliable coding, 
team coder agreements were calculated. Using the recapped statements 
in three case profiles as a base for calculating coder reliability, 
and separating first and second codings by a three month period, 
coding agreements for items in each data set, with one exception, 
ranged between .69 and .96. Reliability in coding tas*. statements 
was .60. Detailed coder reliability data are reported in Chapter 4 
of Volume I of the series of volumes reporting the Oregon Studies. 

Data Storage As soon as the recapped statements had been coded 

and Retrieval for a particular project the codes were forwarded 

to the data coordinator for a check of their com- 
pleteness, and then forwarded to the coordinator of data storage and 
retrieval for transfer into computer storage. After storage, repeated 
checks were run to insure that the initial computer entries were 
covrccl, and the computer center manipulations over time had not 
destroyed or reordered the data as it was originally stored. 
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Profile Format 3 



Ten Profiles in the volume meet the most advanced format require- 
ments.4 These are profiles 1, 2, 6 and 7 in Part One of the volume- 
profiles 9, 10, and 11 in Part Two; and profiles 16, 17, and 18 in Part 
ihree. As a set these profiles reflect the most advanced form of the 
„ a fh C0 ]l eCtl ° n ^thodology, were the last to be prepared, and appear 
s the first profiles to be read in any of the three parts to the 
volume, as well as the first to be read in the Evaluation section of 
iart One. Also, all are organized into six chapters: an Overview- 

a Description of the Parameters of the Project; a Summary of Data; ’ 
Supplementary Data; Project Dynamics; and Implications for Training 
tach profile also contains an Appendix that houses the "recapped" data 

statements from which the output-work requirement data summaries have been 
prepared. UdVC 

An overview of the contents of each chapter in the format 3 profiles 
follows. It will be seen from these ovirview statements that the three 
classes of data collected on a project are collapsed and/or integrated 
ror purposes of their presentation within profiles. 

CHAPTER I : OVERVIEW. This chapter provides the first view of a 

projecc as more than a title. It provides an orientation to the nature 
o. the project, its goals, and its reasons for being, and serves as the 
framework into winch the balance of the profile data are fit Structurallv 
the overview chapter consists of the following parts : V ’ 

(a) Synopsis of the Project 

0^) Objectives, Rationale, and Significance of the Project 
(c) Context in Which the Project Operates 

Chapter I is generally not more than 6 pages in length, and it is 
designed as an abstract" so that readers may determine whether thev 
wish to read tiie profile as a whole. 3 

CHAPTER II: PARAMETERS OF THE. PROJECT. Chapter II emphasizes 

and makes quickly available, a first set of "hard" data about a project 
Standard sections include: H J 

00 Staff structure; 

(b.) Project roster; 

(c) Index of outputs; 

(d) Output map. 

S ^ 3f f ®^ UCtUre data involves a description of the organizational structure 
adopted by a project, and how staff members are distributed within that 
structure; project roster data involves a description of the roles 
p ayed and/or functions performed by personnel within the project* an 
output index is an annotated listing of the outcomes of work effort 
t at project staff iden :ify as critical to the success of the project; 

L \ Each P rofl ' e is identified as to its format number on the back of 
the profile title page. 
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;jii (I /m oil L pu l map is a schematic portrayal o 
[jet ween project outputs. More is said about 
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t la* I n ti! rdependenc i es 
output maps later in the 



CHAPTER III: SUMMARY OF DATA. In terms of the data sets described 

previously, this chapter would be more accurately titled "Summary of 
Work Requirements for Output Production." Three data sets are summarized 
in the Chapter: (a.) the standards held for the production of an output; 

(_b) the tasks engaged in to produce an output to the standards set for 
it; and (c) the knowledges, skills, and sensitivities required to perform 
those tasks. Each of these data sets is displayed in standard tables 
as frequencies of category citations. The narrative text of the chapter 
deals principally with the data displayed in the tables, and the inter- 
relationships of those data. 

CHAPTER IV: SUPPLEMENTARY DATA. The chapter on supplementary data 

varies to some extent as to the specific data it contains. In general, 
however, the following data sets are reported: 

(a) Kinds of outputs generated at varying stages of project 
completion ; 

( b ) The distribution of outputs by their alternative classifi- 
cations, i.e., structure, function, character and level; 

( £ ) Summaries of staff backgrounds; 

(d) Individual job descriptions; 

(_e) Interviewee responses to questionnaire items relating to 
position requirements, support resources, and project 
management ; 

(f) Interviewee responses to questionnaire items citing 

emphases given to various classes of work activities; 

(j>) The funding base of the project. 

Tables of the data are provided when they serve to provide a focus to 
the discussion. Meaningful relationships with data reported in other 
chapters are also pointed out. 

CHAPTER V: PROJECT DYNAMICS. This chapter, by design, is the least 

structured of the profile chapters. The purpose of the chapter is to 
round out the profile by reporting "impressionistic" observations about 
the project. The "data base" for the Chapter was the hunches, observa- 
tions, insights, etc. gained by the data collection team during their 
three to five day stay at the site of the project. These impressions 
are reported in whatever sequence, form, and substance the profile writer 
considered best in calling out the significant and unique features of 
project operation. The freedom of the dynamics chapter to vary in focus 
and content was considered essential to extending the meaning of the 
data collected. It was also seen as essential to methodological develop- 
ment, for it served as the vehicle by which new data thrusts were identi- 
fied for inclusion in the methodology. 
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The substantive focus of the comments included in most project 
dynamics chapters includes some subset of observations wif.h respect to 
staffing patterns, project management structures and procedures, manage- 
ment "styles," project related commitments, substantive issues that 
arise within projects, affective issues, and agency interrelationships. 

The discussion of such observations is linked, when appropriate, to 
"hard" data. The tenor of the discussion is intended to be non-judgmental 
and instructive. 

CHAPTER VI: IMPLICATIONS FOR TRAINING . In this chapter the know- 

ledge gained about a project is assessed with respect to its implications 
for training. In this assessment the data reported in the profiles 
generally are treated very briefly, for it is assumed that the reader 
can draw his own conclusions from his reading. instead, attention 
is directed to comments or recommendations made about training by project 
personnel, or which are implied by the nature of the data collected. The 
discussion frequently focuses on training needs mentioned by project staff 
in relation to problems or difficulties in the project. To this extent, 
the discussion tends to highlight areas of competence in which prepara- 
tion was weak. 

PROFILE APPENDIX. The last chapter in each profile is followed by 
an appendix that contains the "raw" data that is the basis for the coded 
data reported in Chapter III. The raw data consists of the paraphrased 
or "recapped" statements of interviewees that describe the standards, 
tasks, and enablers associated with the generation of outputs. Category 
code numbers are included with each statement to facilitate their loca- 
tion in the various tables presented in Chapter III. The importance of 
this appendix extends beyond its function as an aid to the reader, for 
it represents what is presumed to be one of the most meaningful forms in 
which the data collected in the Oregon Studies can be presented for 
purposes of training. Furthermore, the profile appendix is the only place 
where the raw data on standards, tasks, and enablers appear. 



Profile Format 2 



Six profiles in the volume were prepared according to the format 
that preceeded in time the format just described. These are profiles 3, 

4, and 8 in Part One of the volume: 12 and 13 in Part Two; and 19 in 
Part Three. 

The main differences between formats 2 and 3 lie in the language 
used to describe project outputs. In format 2 the language of output 
structure, function, character, and level vzas not in use, and the distinc- 
tion between products, events, and conditions had not as yet emerged. In 
their place was a language of production and management "products," 
where products served as a loosely defined term to cover what subsequently 
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events, iiiul coiul it i ons . 



was recognized as products, 



These; differences are reflected in tile content of Chapters II and 
III of the format 2 profiles. in all other respects both the content 
and organization of format 2 profiles are consistent with those reported 
in format 3. 



Profile Format 1 



four profiles reported in the volume were prepared according to the 
first profile format developed. These are profiles 5 in Part One of the 
volume; 14 and 15 in Part Two; and 20 in Part Three. Since the varia- 
tion between formats 1 and 3 is considerable, differences will be traced 
chapter by chapter. 

CHAPTER I. Same as in format 3. 

CHAPTER II. In place of an output index and an output map there is 
00 an index of production responsibilities, (b) a production responsi- 
bility tree, (c) an index of management responsibilities, and (d) a 
management network. These correspond to the output index and output map 
of format 3, and for purposes of data analysis were so treated, i.e., 
they were recoded using the data sets reported in format 3 profiles. In 
format 1, production responsibilities are treated much as products are 
treated in format 3, and management responsibilities are treated much 
as events and conditions are treated in format 3. The distinction 
management and production responsibilities, however, are carried into 
Chapters III and IV of format 1, causing two chapters in the profile to 
be devoted to work requirement d-t-.a (s. ch data are consolidated in 
Chapter III in format 3). As is the case in format 2 profiles, the 
language of output index and map, and the language of output structure, 
function, character, and level does not exist. 

CHAPTER III. Entitled DETAILS ON EACH PRODUCTION RESPONSIBILITY, 
this chapter presents the data on standards, tasks, and enablers only 
for products pertinent to the contractual obligations of the project. 

The chapter also contains the recapped interviewee statements (in format 
3 profiles they appear as an Appendix), as well as the category frequency 
data that are based upon these statements. 

CHAPTER IV. Entitled DETAILS ON EACH MANAGEMENT RESPONSIBILITY, 
the chapter simply repeats the format of Chapter III. 

CHAPTER V. Equivalent to Chapter IV in format 3. 

CHAPTER VI. Equivalent to Chapter V in format 3. 



Subsequent to the preparation of format 2 profiles, production and 
management "products" were reclassified into products, events, and 
conditions. Two purposes were served by this reclassification: (a) 

it eased the strain of what had come to be recognized as a forced 
classification; and (b) it enabled the data reported in these profiles 
to be used in cross-project analyses. The recoded data are reported 
in supplementary tables that accompany each format 2 profile. 
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CHAPTER VII. Equivalent to Chapter VI in format 3.^ 
Notes on Reading Output Maps 



The output map found in each of the profiles contains a wealth of 
information about the outputs of the project under investigation. In 
order to extract all the information that a map contains it is essential 
that the rules guiding the construction of a map be understood. 



The Purpose of the Map 

The purpose of the output map is to present as simply and as 
clearly as possible the interrelationships that exist between the various 
outputs of a project. The desired effect of reading an output map is 
a "picture” of the project being discussed in terms of the dependency 
relationships among the outputs the project seeks to achieve. 



The Elements in a Map 

Figure 4 contains an illustrative output map. A number of elements 
can be identified within it: solid line boxes; labels; code symbols; 

horizontal lines; vertical lines; brackets; dotted lines; dotted line 
boxes; and vertical (long and short dash) lines. Each of these elements 
contributes to the total information contained in a map. The following 
paragraphs identify the information presented by each element. 

Solid line boxes 



J j Each solid line box represents a specific output 

that the project is seeking to achieve. If the 
box stands alone (is not connected to any other 
box by a line) one of two conditions exists: 

(a) the output is considered to have value, but is 
not related to any other output, or (_b) the output 
index did not contain output identifications that 
allowed other outputs to be linked to it. 

Labels 



Within each box there is a label which is the 
descriptor of the output represented. The labels 
found in the box are the same ones used to describe 
a particular output throughout 1 he profile. 



Final 

Repor t 



Profile 14 was a transition profile, and is peculiar in that it 
incorporates the language of the profile I format but the organization 
of profile 2 and 3 formats. 
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FIG. 4. An illustrative output map (overall project management 
and technology development). 








Utilisation Plan * ALERT Information 

For ALERT P-50 Sygte» P-58 



¥ 






i 



I 

I 



l 













FIG. 4. Continued (Information products development). 



FIG. A. Concluded (fleld-teat evaluation of Information products) 
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Evaluation Reports: 
ALERT (Products) 

P-19 



Coded symbol 



P-01 Final bach box contains, along with the label, a coded 

Report symbol. Each symbol is composed of a letter which 

identifies the structure of the output (P-product, 
E-event, C-cond i t ion) , and a 2-digit numeral which 
identifies the output sequentially with respect to 
the other outputs in the same profile. Code 
numbers are the same throughout the profile. 



Horizontal lines 




Horizontal lines between boxes indicate that the 
outputs so connected have side-effect relationships, 
that is, the production of one influences the other, 
and vice versa. 



Vertical lines 



Vertical lines between boxes indicate that the upper 
output is dependent on the lower. Until the lower 
output is completed the upper one cannot be completed. 
In the total map, boxes connected by vertical lines 
are hierarchically arranged, those at the top of the 
map being dependent upon all those below. 



Brackets 




Boxes enclosed 
are influenced 
represented by 
bracket (s) . 



by brackets represent outputs which 
by, but not dependent on the output 
the box linked horizontally to the 



Dotted lines 




Dotted lines connecting two brackets are used to 
indicate outputs that are influenced by another 
output when the outputs encompassed by a bracket 
area are large in number, or when influence is 
carried across more than one page of the map. 



Dotted line boxes 



i i Dotted line boxes represent those outputs which 

- - - - - are either generated outside the project, but 

influence it, or are outputs generated by the 
project as a function of other outputs but have 
not been indexed by project staff. 



Vertical 

i 



(long and short dash) lines 



When more than one page is needed to display an 
output map, vertical lines (long and short dash) are 
used on the right of the first page and the left of 
the second page to indicate the point at which the 
two pages coincide. 
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on i' d unusu ^. circun,stances Som0 outputs may appear more than 
Ln differPnr P ' lh “ rcHU \ ta when thc y are related to other outputs 

Wl,on [r r • WayS, -e 1 ' e '’ de P endent on one set but Influenced by another. 
Wlien is impossible to display both the relationships by one place- 
ment, outputs are repeated. • P y P 



elements wftM r ■ T map is underst0 °d and the various 

eiements within it are defined, the reader should be able to extract 

should a f laforraation frora a careful analysis of a map. It 

to dl an la H ° h ° W ? Ver ’ that an map does not attempt 

y relationships as do ot her process charts such as PERT 

n output map focuses on the dependency relationships existing between’ 
outputs, independent of the factor of time. " 
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GLOSSARY OF COMMON PROFILE T FILMS 



This glossary contains definitions of terms used frequently in the pro- 
files. Asterisks identify terms that were used in the early forms of 
the profiles, These terms, no longer in use, are identified with a 
single asterisk to indicate their appearance in profile format 1 and a 
double asterisk to indicate their appearance in profile format 2 . When 
terms are used in a definition that are themselves defined in the glossary, 
they appear in capital letters. 



ADOPTION. A circumstance in which KNOWLEDGE, INFORMATION, and/or 
TECHNOLOGY is utilized. 

CHARACTER OF OUTPUT. See Output Character . 

COMPONENT OUTPUT. An outcome of work effort that constitutes an element 
of, or an approximation to, a FOCAL OUTPUT. 

CONDITION. An outcome of work effort that creates a desired circumstance 
expected to endure over the life of a project, or as a result 
of i t . 

CONTEXT. See Project Context . 

DEVELOPMENT. A problem-solving strategy designed to produce reliable 
technology, that is, procedures, materials, hardware, and 
organizational frameworks that have a known degree of success 
in bringing about a particular outcome or in performing a 
defined operation: also used to designate the focus of 
projects (see Project Focus ; and the focus of outputs (see 
Output Focus ) . 

DIFFUSION, A problem-solving strategy designed to bring about the 

implementation of generalizable knowledge, a reliable tech- 
nology, or trustworthy information (as used here diffusion 
incorporates both the concepts of DISSEMINATION and ADOPTION); 
also used to designate the focus of projects (see Project Focu s) 
and the focus of outputs (see Output Focus ) . 

DISSEMINATION. A circumstance in which KNOWLEDGE, INFORMATION , and/or 
TECHNOLOGY ia distributed to a targeted population. 

EDUCATIONAL RDD&E. A coordinated set of problem-solving strategies 
designed to produce outputs that can be judged as to their 
quality and their contribution to the solution of educational 
problems . 

ENABLER. KNOWLEDGES, SKILLS, and SENSITIVITIES needed to produce a 
particular output . 



KNV IKONMKNTAL MANAGEMENT KKSI’ONSI I1IL1TY. * Responsibilities which, when 
carried out, result in outcomes that enhance nr i at: Ml late the 
environment in which a project operates. (Subsequently, only 
tlie outputs of these responsibilities were* analyzed.) 

EVALUATION. A problem-solving strategy designed to produce trustworthy 
information regarding a phenomenon which occurs in a context 
or environment over which the user expects to exercise 
influence or about which lie expects to make decisions; also 
used to designate the focus of projects (see Project Focus ) 
and the focus of outputs (see Output Focus ). 

EVENT. An outcome of work effort that results in the occurrence of an 
observable transaction or set of behaviors. 

FACILITATING OUTPUT. An outcome of work effort that supports the 
generation of FOCAL or COMPONENT OUTPUTS, but is not in 
itself a part of such outputs. 

FOCAL OUTPUT. An outcome of work effort expected by contiactual 
obligation to emerge from a project. 

FOCUS. See Project Focus and Output Focus . 

FUNCTION. See Output Function . 

IMPLEMENTATION. A classification given an output of DIFFUSION, i.e., 
an instance of the ADOPTION and UTILIZATION of KNOWLEDGE, 
INFORMATION, and/or TECHNOLOGY; the objective of DIFFUSION. 

INFORMATION. A classification given an output of EVALUATION, i.e., an 
instance of reliable information about a given phenomenon 
within a context over which a user expects to exercise 
influence or about which he expects to make decisions; the 
objective of EVALUATION. 

KNOWLEDGE (AS ENABLER). A classification given an ENABLER that 

identifies it as a fact, principle, or generalization, and that 
can stand the test of empirical verif icatiun ; 3lso, any 
circumstance that can be shown to exist. 

KNOWLEDGE (AS OUTPUT). A classification given an output of RESEARCH, 
i.e., an instance of established fact, principle, etc. that 
is generalizable and that can stand the test of empirical 
verification; the objective of RESEARCH. 

LEVEL OF OUTPUT. See Output Level . 

MANAGEMENT FUNCTION. A classification given an output that orchestrates 
the resources (time, personnel, materials, space, information) 
available to a project for the realization of the outcomes 
expected from it: also a report of that orchestration. 



xxxvi 



MANAGEMENT NETWORK (also 'UNAGEMENT RESPONSIBILITIES NETWORK).* A 

hi or.-irchi cal ordering that graphically illustrates t he functional 
relationships between MANAGEMENT PRODUCTS and RESPONSIBILITIES 
wLtliLu a project. ( Subsequent Ly incorporated within output 
maps . ) 

iff A 

MANAGEMENT PRODUCT. A classification given a product serving a 

MANAGEMENT RESPONSIBILITY . (Subsequently Identified as a 
product ierving a MANAGEMENT FUNCTION.) 

MANAGEMENT RESPONS I B I MTY . * See Environmental Management Responsibility 
and Prod uction Management Responsibility . 

MANAGEMENT RESPONSIBILITY INDEX.* A listing of the MANAGEMENT RESPONSI- 
I3ILITJES within a project. (Subsequently incorporated within 
the OUTPUT INDEX.) 

OUTPUT. Ail identifiable outcome of targeted work activity that con- 
tributes to the realization of project goals. 

OUTPUT CHARACTER. The attributes of an output that mark it as an instance 
of KNOWLEDGE, TECHNOLOGY, IMPLEMENTATION, or INFORMATION. 

OUTPUT FOCUS. The attributes of a FOCAL OUTPUT that mark it as an output 
of RESEARCH, DEVELOPMENT, DIFFUSION, or EVALUATION. (In 
Format 1 and 2 profiles, all outputs are classified in terras 
of an ROD or E focus.) 

OUTPUT FUNCTION. The attributes of an output that mark it as serving 
a POLICY, MANAGEMENT, or PRODUCTION FUNCTION. 

OUTPUT INDEX. An annotated listing of the outputs of a project. 

OUTPUT LEVEL. The attributes of an output that identify its relationship 
to project goals as FOCAL, COMPONENT, or FACILITATING. 

OUTPUT MAP. A graphic portrayal of the functional interdependencies 
among the outputs of a project. 

OUTPUT STANDARD. A criterion applied to, or level of excellence expected 
of, an output; a criterion by which the adequacy of an output 
is judged. 

POLICY FUNCTION. A classification given an output that establishes 
standards or guidelines for a project. 

PROCESS/OPERATIONS STANDARDS. A criterion applied to, or level of 

excellence expected of, the processes/operations engaged in 
in producing an output; a criterion by which the adequacy 
of processes/operations are judged. 

PRODUCT. A tangible or "hard" outcome of work effort, concrete in 
form, ami transportable at a givei. point in time. 
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PRODUCTION FUN CT JON. A cl ass i f i ca t i on given an output, that is a part 
of the total fabrication effort of a project. 

PRODUCTION MANAGEMENT RESPONSIBILITY. * Responsibilities which, when 
carried out, result in outcomes that enhance or facilitate 
the generation of proejets for which the project is responsible. 
(Subsequently, oniy the outputs of these responsibilities were 
analyzed . ) 

PRODUCT TREE or PRODUCTION RESPONSIBILITY TREE.* A graphic portrayal 
of the functional interdependencies among the products of a 
project (equivalent to an OUTPUT MAP, except it contains 
only PRODUCTS). 

PROJECT. A formally recognized, funded and directed effort aimed at 

achieving one or more specified ends that have their definition 
in educational RESEARCH, DEVELOPMENT, DIFFUSION, and EVALUATION. 

PROJECT COMPLEXITY. A project dimension defined in terms of level of 
funding and duration. 

PROJECT CONTEXT. A project dimension defined in terms of institutional 
setting, e • g • , schools, colleges and universities, publicly 
supported laboratories and R&D centers. 

PROJECT FOCUS. A project dimension defined in terms of primary emphasis 
of work effort, i.e., RESEARCH, DEVELOPMENT, DIFFUSION, and 
EVALUATION . 

RESEARCH. A problem-solving strategy designed to produce reliable 
KNOWLEDGE, that is, facts, principles, theories, and laws 
that are generalizable and that can stand the test of 
empirical verification; also used to designate the focus of 
projects (see Project Focus ; and the focus of outputs (see 
Output Focus ) . 

SENSITIVITY. A classification given an ENABLER that identifies it as 
an increment of av/areness about an environment or factors 
operating in or upon an environment; also, attitudes and 
personality characteristics. 

SKILL. A classification given an ENABLER that identifies it as an 
ability, proficiency or expertness in the exercise of an 
art, craft, or science. 

STANDARD. See Output Standard and Pro cess /Ope rat ions Standard . 

STRUCTURE OF ENABLERS. A classif icat ic’i given ENABLERS that identifies 
them as KNOWLEDGES , SKILLS, or SENSITIVITIES. 

STRUCTURE OF OUTPUTS. A classification given OUTPUTS that identifies 
them as PRODUCTS, EVENTS, or CONDITIONS. 
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STRUCTURE OF STANDARDS. A Classification 8 i ven STANDARDS that -a ... 
the as OUTPUT STANDARDS or PROCESS/OPERATiS m^S 



TASK. 



A unit of work performed in producing a specified OUTPUT i 
specified STANDARD. fa p 111 d UU1PUT to a 



TECHNOLOGY. A classification given an output of DEVELOPMENT i e 

can brin V Pr ° CedUre pr ° duct when ’applied 

the oh^tt° U of a D^S E NT nd “ ith * k '“ OT reliability 

See Product Tree. 



TREE . 



UTILIZATION. A circums 
TECHNOLOGY is 



ance in 
employed 



which 
in ac 



KNOWLEDGE, 

complishing 



INFORMATION, and/or 
a goal or end state. 
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Three profile formats are represented in this volume. 
The reader should refer to this number when making 
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Chapter I: Overview 

i 






This chapter is a brief introduction to the project "Alternatives 
for Learning Through Educational Research and Technology* 1 (ALERT) con- 
ducted by the Far West Laboratory for Educational Research and Devel- 
opment (FWL) . 



Synopsis of the Project 

Title: Alternatives for Learning Through .Educational Research 

and Development. 

Responsible Institution: Far West Laboratory for Educational Re- 

search and Development. 

Funding Source: U.S. Office of Education, National Center for 

Educational Research and Development. 

Funding Duration: April 1970 to June 1973. (38 months) 

Observation Date: June 1971. 

Present Stage of Development: Mid-Project 

RDD&E Focus of Project: Educational diffusion. 

Target Group of Project: Professional staff at elementary and 

secondary school level. 

Expected Outcomes: 1. ALERT Information System. 

2. ALERT Information Package. 

Level of Funding and Duration: High-Medium (level 6 of 7 levels) 

Agency Setting: Regional educational laboratory. 



Staff Summary (at time of observation): 

Total Full Time Equivalency (in man 
years) : 

Number of Personnel Assigned: 

Number of consultants: 

Number of Doctorate Degrees: 

Number of Master’s Degrees: 

Number of Bachelor’s Degrees: 



Professional Support 



3.50 

13 

1 

5 

7 

1 



(six interviewees only) 
5 (clerical) 

7 (technical) 



Major Area Specialities oi Professional Staff (for six interviewed staff 
members only): social psychology, communications research, special educa- 

tion, French, English/writing, and psychology. 
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l ivt^Sjj Ra t IntKi l u, and Sign i f iramu of Mk'_ Projurl 

The genera I objective or purpose of the ALERT Project is the devel- 
opment of an information diffusion system. The system is being derived 
empirically by field-test evaluation of both the system outputs and 
the system technology. 

The goals of the system outputs, as conceived by the project develop- 
ers, reside in the facilitation of rational decision-making by the user. 
The user is seen as any "decision-maker" in the school from the admin- 
istrator to the community spokesman, including the student. The per- 
formance goals, as stated by the developers, are: 

L . To increase the users 1 awareness and knowledge of 
alternative products and programs (developments) 
that have been demonstrated to increase children’s 
opportunities to learn. 

2. To provide users with available facts, trends, class- 
ification schemes, and criteria needed to comprehend 
these developments . 

3. To encourage the users to apply this knowledge to their 
local situation by rationally deciding whether to 
adopt, reject, or adapt these developments. 

The goals of the system technology are to eventually place 
in the hands of a publisher or another agency/client, an empiri- 
cally evaluated technology for the efficient collection and accurate 
and objective processing of information about educational devel- 
opments . 

ALERT is built on the identified need to fill the gap between 
the developer and the practitioner. It is stated by the developers 
of ALERT that "most of the information about educational develop- 
ments does not exist in forms that are easily retrievable, intelligible, 
and applicable for school personnel” and that "school personnel 
generally are not prepared to make effective use of the existing in- 
formation and resources.” 

The products of ALERT are oriented around subject area devel- 
opments at the elementary and secondary school level. The infor- 
mation is both global and detailed enough to allow the user flexibility 
and range of choice in use. In addition, the comprehensive coverage 
of a subject in one or a few readily available packages is also 
important to the practitioner who is seen as having little time for 
extensive personal research of a development. 

ALERT is also seen as a complementary information system to 
both the ERIC (Educational Resources Information Center) information 
system and PREP information packages. In both cases it is character- 
ized as providing information at a level or in a format that facilitates 
practitioner use. 
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The development procedure or strategy of ALERT is twofold. First is 
the planning, designing, prototype production, field-test evaluation, 
and revision of multimedia, multilevel, mailable materials chat go 
to the practitioner/user. Second is the definition and development, 
field-test evaluation, and revision of the technology, necessary to 
produce packaged information that can be delivered to other agents 
to continue the work. The general developmental strategy of FWL is 
outlined in more detail in Appendix E. 



Context in Which the Project Operates 

Figure 1 illustrates the contextual influence and relationships 
that play a significant role in the ALERT Project. The following 
discussion is a brief exploration of those influences and relation- 
ships as identified in observation of the project. 

Relationships to other agencies * The ALERT Project resides 
in the Communication Program (Division) of FWL. The primary rela- 
tionships of the project with agencies outside the Laboratory are 
those with funding source agencies, field-test site agencies (schools), 
and product distributing agencies. 

The U.S. Office of Education (USOE) is the primary source of 
funds for this project, as well as for the whole Laboratory. A 
basic contract through the Laboratory with the National Center for 
Educational Research and Development (NCERD) within USOE is the 
primary source of money for the ALERT Project. Additional funds are 
available in three contracts through the National Center for Educa- 
tional Communication (NCEC) , also in USOE. These contracts are 
treated as separate project contracts, but they are coordinated within 
the ALERT Project work and will feed into ALERT. These contracts 
were identified as PREP packages on Evaluation, Early Childhood Edu- 
cation, and Drug Education. Thus, the work in ALERT is funded by 
NCERD through a basic contract and NCEC through three project 
contracts . 

The current year (1970-71) field-testing in ALERT is being 
accomplished in approximately 75 to 100 site schools in five states. 

This includes districts as well as specific schools. After an in- 
formation product of ALERT was placed in the schools, liasion was 
maintained and various evaluation instruments administered by the 
evaluation team. Most of this is done by mail. This current field- 
testing is a main or performance field test, the second of a three- 
stage testing cycle. The schools that participate in the field test- 
ing may or may not participate in the full three-stage cycle. All 
information products in development are distributed only by the project. 
Once developed into-a form for release, they are available for 
general distribution. 

Two dis tributors ,Technicon and EPIE, are currently responsible 
for general distribution of the two ALERT Information Units in 
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release form. These two units are the Elementary Science Information 
Unit, distributed by both Technicon and EPIE, and The Social Studies 
Information Unit distributed by Technicon. 

Relationships within the parent agency . The most significant 
direct relationship of the project identified within the agency, and 
specifically within the Information Processing Component (Program) of 
The Communication Program (Division) was that of coordination of the 
three NCEC contract projects within ALERT which were mentioned previously. 
The Programs (Division) within the agency function almost exclusive of 
each other. The Program Directors Council, which is responsible for 
setting program (Division) level policy, does bring together the pro- 
gram interaction. Of course other specific relationships with the agency 
that directly or indirectly effect the ALERT Project, such as policy set- 
ting by top management, certainly do exist. However, such relationships 
were not identified during the observation of the project. 

One of the primary and direct influences within the agency that 
affects the ALERT Project is the general developmental strategy of the 
Laboratory as a whole (see Appendix B). This strategy has been directly 
adopted for the development of ALERT. 

Other relationships . A significant relationship for the Communi- 
cation Program (Division) that indirectly affects the ALERT Project is 
that with the National Advisory Committee for the Communications Pro- 
gram (Division). A similar committee exists for each of the four pro- 
grams fo FWL. These committees are staffed by two members from the 
Executive Panel, an advisory group in the FWL management structure, 
and three to five members who are nationally prominent within the area 
of concern of the particular program. This committee reviews plans 
and goals of the program while surveying and interpreting national 
trends relevant to the program. 

Another relationship that serves ALERT directly is that with ERIC. 

In the information collection process of ALERT, ERIC is used as a source 
of input. This relationship is apparently not of a special nature, how- 
ever, questions as to how these sources might be coordinated into a com- 
prehensive "practitioner-oriented information system" are also dealt 
with . 



Time lines . Time lines were not available to the observation team. 
The Project Director indicated that a master schedule for ALERT did 
exist. However, it was emphasized that this schedule was plotted on a 
time line per task, showing a sequence of critical events at the task 
manager* s level only. 

The ALERT Project as a second generation information system and as 
an integrated work effort has been in existence about one year. The 
estimates for complete development of the ALERT information system 
range from three to five years. 



• The "I I I I.t III.' Cnmimmlr.ll lull 
Prugrnin ( I) I v I n Inn) .in- I or ;i I cl In downtown Iterkelov. Thu main oil ires 
ul I'Ve are I nciitwl some* d I st a lire away, but also in It.-rkeley. Tim 
Com nil j ca 1 ion Program occupies part of the first floor and all ol the 
third door of the building in which it is located. Most all the 

tasks necessary to the ALERT Project are being carried out within these 
of f ices . 
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Pa ramet ers of the* Project 



This chapter discusses the staffing pattern «>f the project, inr hides 
. i tost or o: staff, dosrr :hos the outputs being genera to*! , and shows the 

dependent- relationship^ of the outputs in an lutpu* mop. 



P ro j e c t _S true ture 

St a f f structur e . As illustrated in Figure 2, the essential elements 
of the staff structure in this project is a four level structuring of 
personnel, which is oriented upon task-f ocused teams. The project was 
recently reorganized to allow the diffusion of some authority and respon- 
sibil i t y from the Component Director downward into junior staff or task 
managers. This was to provide a par t ic i pa t i ve management structure 
that could improve communication along the vertical dimension. Also, this 
restructuring anticipates a general Laboratory reorganization in which 
Programs will take on a Divisional status and Components will probably 
Lake on Program status. The restructuring within the project has also 
altered the nature of the teams significantly. 

Each team was originally, and to an extent still is, focused on 
a subject area. These teams tended to be fixed and were usually made 
up of one to three people plus the team leader. The subject area of a 
team might be English and language arts, or science and mathematics, or 
the team might be concerned only with evaluation or production. In 
a sense, each team is a department. 

This structure still exists to an extent. However, superimposed tpo i 
it is the task-oriented team structure. Here one or more teams are or- 
ganized to work on a task such as production of an information unit, or 
production of sort cards, etc. Unlike the team leader, the task manager 
is responsible for his own budget, time lines, expenditure graph, and 
monthly reports. The task manager is e 1 so usually responsible for more 
people and, in a sense, is a short-term project manager. The task-focused 
teams tend to be much more flexible both in numbers on team and duration 
than the subject-focused teams. The tasks cut across the subject areas 
and draw upon people in these areas as needed. Thus, the task managers 
must also negotiate for personnel. 

At the time of observation both team structures were operating. 

Some transitional conflicts were noted. Staff at the team or task level, 
in some cases, indicated some confusion with their new roles and a lack 
of preparation for assuming some of their new responsibilities. 

The Component or Project Director, at the time of observation, was 
acting (interim) director and had been with the project less than one 
year. A permanent director was due to assume his responsibilities shortly 
after our observation of the project. During this time the Program (Division) 
Director was strongly influencing the directions and management of t lie project. 
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Project roster. The following staff members were interviewed for 
information about the project and selected outputs. 

Titles and primary responsi- Outputs around which staff 

bilities of project personnel member was interviewed 


i. 


Program (Division) Director: 
Responsible for providing program 
level supervision and leadership 


C-56 . 2 


Conceptual Leadership for 
Froject 




to tlie project. (.10 FTE)1 


C-54 . 


Staff Morale 


2 . 


Senior Program Associate I 
(Acting Project Director) : 


P-14. 


Report Manual (for Writers) 




Responsible for middle level 
project management and 


E-5 7 . 


Staff Hiring 




supervision including 
planning, maintaining general 


C-26 . 


Staff Welfare 




budget, maintaining general 
time lines, monitoring task 


P-58. 


ALERT System 




level budgeting and work 
progress, and answering 
legal responsibility for 
project. (.75 FTE) 


C-54. 


Staff Morale 


3. 


Senior Program Assistant II 
(Task Manager) : Responsible 

for budgeting, scheduling. 


P-01. 


Initial ALERT Packages. 
(Recipe Box) 




coordination, and monitor- 
ing of work of writing 
team(s) as well as writing 
and editing project ma- 
terials. (.90 FTE) 


P-14. 


Report Manual (for Writers) 


4. 


Senior Program Assistant II 
(Evaluation Team Leader/ 
Manager) : Responsible for 


P-25. 


2nd Year Main (Performance) 
Field-test Plan for ALERT 




budgeting, scheduling, co- 
ordination, and monitoring of 


C-54. 


Staff Morale 




work of evaluation team. Other 
duties include writing reports, 
preparation of data collection 
instruments, supervision of 
data collection, and preparation 
of evaluation plans. (.80 FTE) 


E-55 . 


Meeting of ALERT Staff to 
Discuss a Publisher’s 
Proposal 


5. 


Senior Program Assistant I 


P-16. 


Information Units 



(Task Manager) : Responsible for 

planning and coordinating writing 
team(s) T work, monitoring pro- 



gress, maintaining budget, 
assisting in design of question- 
naires, surveying project related 
literature, and writing reports 
and project materials. (.20 FTE) 




■1-Full Time Equivalency 

^An arbitrary code number (see ,# Tri£ex of outputs") • 



Report Manual (for Writers) 



() . Program Assistant II (Writer/ P-14. 

Editor) : Responsible for co- 

ordinating efforts with one 
assistant in update of the 
Elementary Scir.ice Information P-16. Information Units 

Unit including writing and 
editing, reporting to task 
manager, and locating new 
developments in the field. 

(.75 FTE) 



Two program staff members, one that was formerly ful] time on this 
project but at time of observation was working on another project , and a 
second in another component of the Communiccation Program, were interviewed 
to collect contextual and interrelationships information abo*iL the ALERT 
Project . 

The total project staff for ALERT numbered about 25 at the time of 
observation . 



Outputs Generated 

During the observation and interview period on the ALERT Project, sig- 
nificant outputs^ were identified and formal interviews were conducted a- 
round selected ones. Those project personnel who were linked to selected 
outputs were interviewed about their roles in generating the output. These 
outputs are annotated and summarized in the following section. 

Index of outputs . Ten outputs of 57 identified 
(see Appendix A) were interviewed around. An arbitrary identification number 
has been given to each and is composed of two parts: (a) a letter which per- 

mits easy identification of the output as either a product (P) , condition 
(C), or event (E)^, and (b) a sequence number lor all outputs irrespective of 
P, C, or E. These outputs are as follows: 

P-01. Initial ALERT Package (Recipe Box) . A box of 

edge-punched sort cards each briefly describing an educa- 



^An identifiable and significant planned outcome (product, event, con- 
dition) of targeted work activities, with targeted work activities being 
actions directed toward the realization of projected goal states. 

^Product - A tangible or "hard" outcome of work effort that survives 
in a form that is transportable, such as a report. 

Event - An outcome of work effort that results in the occurrence 

of an observable transaction, such as an interview. 

- An outcome of work effort that results in the creation 
of a desired circumstance, such as fiscal responsibility. 



Condition 



tional development program. In addition to the sort cards 
the package includes instructions and guides for its use. 



P-14 • Report Manual (for Writers^ . Guidelines for preparation 
of ALERT reports. 

P-16. Information Units . An information package* usually describing 
five to eight exemplary development programs in a selected 
subject area. The unit may contain summaries or survey 
level information, audiovisual briefings, and detailed re- 
ports per each program presented. 

P-25. 2nd Year Main (Performance) Field-test Plan for ALERT . Pro- 
cedures for field-test data collection and analysis extended 
from the initial one year plan. 

C-26. Staff Welfare . The assurance and monitoring of staff produc- 
tivity and communication. 

C-54. Staff Morale . The maintenance of a mutually participative staff. 

E-55. Meeting of ALERT Staff to Discuss a Publisher's Proposal . An 

event within the duration of the project at which the senior 
and junior staff evaluate a submitted proposal. 

C-56. Conceptual Leadership for Project . The condition of well 
defined conceptual directions, supervision of such, and 
stimulation of staff to build on initial conceptualization. 

E-57. Staff Hiring . An event involving the identification of a 
need for additional personnel, dissemination of position 
vacancy information, and selection of qualified applicants. 

P-58. ALERT System . A manual information diffusion method. 

Output map . Figure 3 represents the dependency relationships of the 
57 identified outputs of this project. This representation is not necessarily 
sequenced over time. Those outputs interviewed around are identified in the 
map with an asterisk. 



I’ig* 3, Output map. 
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Fig. 3. Output map continued. 



Fig. 3. Output map concluded 
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Chapter III: Summary of the Data 



The interview data collected from the project staff are presented in 
this chapter in a summary form of coded statements. The coded statements 
themselves are found in Appendix A and the tables included in this chapter 
each summarize this data by category and by the outputs interviewed around 
during the site visit. The interviews sought to elicit for each output to 
be analyzed the standards by which one judges satisfactory completion of 
the output, the tasks required to generate an output meeting those stan- 
dards, and the enablers (knowledges, skills, sensitivities) which facili- 
tate the carrying out of those tasks. 

Within each category is a series or set of descriptive labels which 
are representative of interviewee statements (raw data) within a particular 
category. These descriptive labels are listed in the table under the cate- 
gory heading. In the process of reducing the raw data, narrative interviewee 
statements (raw data) about an output were linked to one of the three major 
categories. Each narrative statement was then classified by means of a 
number code according to the most representative descriptive label within 
a given category or subcategory. 

Each table provides the frequency with which interviewees cited 
specific statements (which are represented by the descriptive labels 
in the tables) of standards (Tables 1 and 2), tasks (Table 3) and 
enablers (Tables 4, 5, 6) in relation to the outputs that are listed.-* 



Standards Held for Outputs 

Tables 1 and 2 present the standards elicited against the listed outputs. 
The standards are subdivided and tabulated under two major sets or categor- 
ies — Output standards (Table 1) and Process standards (Table 2) . 

Of the statements elicited from the interviewees relative to output 
standards, there was a slight concentration opon the Utility or Value 
of an output. Looking at some of the narrative statements in Appendix A, 
Utility or Value of the outputs listed in Table 1 refers to: 

Practical and convenient to- use-. 



If the reader is interested in the narrative statements of the inter- 
viewees (raw data), these can be found in Appendix A. To locate the 
narrative statement for any given category, first note the output and 
its identification number in the table. Second, note that each descrip- 
tive label within a given category has a distinct number or code. Turn 
to Appendix A and locate the output. Under the output locate the category 
label or heading (standard, task, or enabler) and pinpoint the number or 
numbers (depending on the frequency cited) of the descriptive label which 
appeared in the table. The statement in the appendix opposite this number 
is the original narrative statement from an interviewee and is only repre- 
sented in the table by the descriptive label and its numerical coding. 
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01 Completeness of content 

04 Communication and clarity 

05 Utility or value 

06 Acceptance by users 

07 Personal satisfaction/feeling 

11 Appropriateness design/content 

12 Goal attainment 

13 Acceptance by others (in proj) 

17 Internally consistent 

18 Satisfactory appearance 

20 Performs consistently 

21 Sources of variance controlled 

22 Functions as planned 

23 Successfully constrains/guides 

24 Terminology appropriate 

28 Operable by others 

29 Meets design expectations 

33 Inclusions are representative 
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Manual, is useful lo in t ended nsci / 1 ar^et audience. 

Manual luc Cu have utility for or he equally servie- 
'ib*e 1 r j nhouse (l abor Kory) writer?* ns veil as 
.h* j < er.u'-i users of annuals. 

’ ustr ef. - far information to assist in 

c jl if- 1. a- 'axing . 

‘■i* 4 ?.. r k* that ‘Ik- majority of ih? narrative statements represented 
th*** ues t - p t i ■; 'i la.e.l ility ._>• value 11 were cited in relation to 
one output — the Report Manual for Writers. 

Within the Output standards table there were a total of 34 narrative 
"standard" statements elicited from interviewees relative to six outputs 
^ ‘ he A7-ER1 druieut. Note, however, that there are only 18 descriptive 
Lab. i ;.hu u.Vput standards categories which are listed to represent 
thc'*n 34 narrative statements. 

Of the standards cited, the majority were reported in relation to 
two of the outputs — the Report Manual for Writers and the Information 
Units. Note also the wide variety of standards that were cited for each 
of these two outputs. 

Associated with the production dimension are standards dealing 
with the processes of managing staff and resources to produce the in- 
tended outputs of the project (Table 2). Concentrations of process 
standards (slightly more than one-half) appear in relation to Staff 
Welfare and Staff Hiring. In terms of Staff Hiring, the data 
seem to indicate concern with hiring qualified staff that will meet 
certain specified criteria and will be able to competently execute the 
specified tasks. The data further indicate concern with allowing the 
staff adequate latitude in carrying out tasks, and balancing the de- 
mands with their capabilities and interests. 



Tasks Pertaining to Output Attainment 

In Table 3, a total of 167 narrative "task" statements were elicited 
from interviewees relative to 10 outputs. These 167 narrative statements 
are represented in Table 3 by 19 descriptive labels from the task 
categories. 

Of the 10 outputs analyzed, five were tangible outputs or products 
and five were events or conditions seeking either to control, facilitate, 
or direct the production and diffusion of those products. The majority 
of tasks cited (114 narrative statements) were in terms of the tangible 
outputs or products with task concentrations on the Initial ALERT Pack- 
age (recipe box), the Report Manual for Writers, and the Information 
Units. In terms of the events and conditions, tasks were focused upon 
Staff Welfare (13), Staff Hiring (11), and Conceptual Leadership (11). 
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TABLE 3 

Task* Cited for Each Output Analyzed 



Project Outputs 
No. Label 



Cluetera of Taake 

(Category code no. end label for coding set NO) 



s a 



2 3 



U • ? 



O 

A 



l B 



2 8 



X 

■**> 

8 

P. 

% 

O 

>s 



oo a 

a -h 

•H 4J 



? 

U 

Q 



X ? 



5 

8 



n 

r*. 

o 



« 

s 



Output 
To tele 



P-01 Initial ALERT Package 
(Recipe Box) 

P-14 Report Manual (for 
Writers) 

P-16 Information Unite 

P-25 2nd Year Main (Perform- 
ance) Field-Teat Plan 
for ALERT 

C-26 Staff Uclfcrc 

C-54 Steff Morele 

E-55 Meeting of ALERT Staff 

to Dlecues a Publisher's 
Propoeel 

C-56 Conceptual Leadership 
for Project 

E-57 Staff Hiring 

P-58 ALERT Syctem 



3 11 1 1 3 

2 2 3 3 11 

14 12 1 



3 

1 1 



3 1 



3 13 2 1 

13 3 



13 12 



31 

23 

32 

12 

13 

ie 



10 1 



2 11 
CM 



3 1 



1 2 



1 3 



U 

U 

14 



Cluster Totals 



18 



9 21 8 15 4 11 13 5 19 



165 





0 



y ju 



In terms of t hr Initial ALERT Package and Mir Report Manual, there 
arr multiple entries for the descr ip t i ve labels Producing the Output 
and Assessing the Output Quality respectively. The data indicate that 
in terms of the Initial ALERT Package 11 distinct yet similar tasks were 
executed within the general activity/classif icat ion of Producing the 
Output, Since one of the primary goals Is to produce ALERT Packages, 
it seems logical that tasks would be concentrated within the aforemen- 
tioned descriptive label. 

Relative to the Report Manual for Writers, data indicate a concen- 
tration of activity within the task category of Assessing the Output 
Quality. However, the number of tasks represented by this desciptive 
label do not constitute a majority of the total number of tasks reported 
in relation to this particular output. It only represents about one-half 
of the total tasks reported. Further, given the intended use of the out- 
put (Report Manual for Writers), the clustering of tasks around this 
descriptive label seems to be appropriate to ensure its effectiveness 
and usability. 

Heavy concentrations of tasks appear under the following descrip- 
tive labels: Clarifying the Problem Addressed (18), Producing the 

Output (21), Assessing the Output Quality (15), Effecting Account- 
ability (13), and Effecting Quality Control (19). Since the primary 
goal of this project is to produce and diffuse ALERT Packages and the 
ALERT System, the areas in which the tasks have been focused (as stated 
above) seem logical and appropriate. Note that a good deal of attention 
seems to be given the tasks relating to effecting quality control. 
Generally this involves monitoring work progress and resources and 
critically reviewing project activities and outputs. 



Enablers Pertaining to Output Attainment 

Tables 4, 5, and 6 present the enablers elicited from the interview- 
ee*; against the listed outputs. Enablers are subdivided and tabulated 
under three major sets or categories — knowledges (Table 4), skills 
(Table 5), and sensitivities (Table 6). 

Within Table 4 there were a total of 37 narrative ’’knowledge" state- 
ments elicited from interviewees relative to nine outputs. These 37 
narrative statements are represented in this table by 14 descriptive 
labels from the knowledges category. 

Knowledge requirements clustered largely around Subjects Related to 
RDD&E and Project Variables, External. Looking at the narrative state- 
ments in Appendix A, these knowledges generally refer to: 

Curriculum developments or packages. 

Research and evaluation designs. 

Statistical and analysis procedures 

applicable to data that have been collected. 
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TABI.K 4 

Enabling Knowledge* Cited for Each Output Analyzed 



Project Output* 
No, Label 



P-01 Initial ALERT Package 
(Reclpa Box) 

P-14 Report Manual (for 
Writer*) 

P-16 Information Unit* 

P-25 2nd Year Main (Perform- 
ance) Field-test Plan 
for ALERT 

C-26 Staff Welfare 

C-54 Staff Morale 

fc-!>3 naeting of ALERT Staff 
to Discuss a Publisher' 
Proposal 

C-56 Conceptual Leadership 
for Project 

E-57 Staff Hiring 



Primary Categories of Enabling Knowledge* 
(Category code no, and label for coding, set S-l) 



*1 <rt 



>> 



§ e s 



W *J 4J 



V -4 



U 44 4J «J 



E 



S o ■ 



s l X £ 



Output 

Total* 



6 

10 

6 

1 

3 



Category Total* 



3928122111213 



2 

1 

37 





21 



f 



V 



\, 



t 



? ^ 







- 






02 


Facilitating people Jnteroctn 


N) 




- 






05 


Programming project events 


•• 


- 




K) 




08 


Analytical read Ing/atudy 




- 


k> 


Kl 




10 


Analytical data handling 


- 






- 




•11 


Disciplining self 


OD 




»— 


K) 


CJ Kl 


14 


Writing 


- 


- 








15 


Presenting or*.lly 


- 








- 


17 


Interpreting language 


K) 








- - 


18 


Finding f lts/lntegratlng 


*» 


- 




i*» 




19 


Planning/conceptualizing 


K) 


- 




- 




20 


Exercising judgment 


- 






V- 




21 


Tracking act lvit les/goals 


- 






- 




22 


Estimating expenses/resources 


- 


- 








23 


Persuading/ justifying 


M 








Kl 


24 


Explicating goal s/procedures 


fo 




h* 


- 




27 


Using equipment /systems 


- 




- 






29 


Getting other’s to perform 


u» 






- 


- - 


32 


Identifying/correcting errors 


- 






- 




33 


Graphically illustrating 


u» 




K) 


- 




34 


Coordinating activities 


tj 




- 


- 




38 


Using resources effectively 


- 






- 




42 


Eliciting responses 


- 






- 




45 


Assessing personal performances 


u» 






Kl 




49 


Interacting productively 
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Enabling Skills Cited for Each Output Analyzed 



Enabling Senaltlvltlaa Cited for Each Output Analysed 
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Category Total* 



There is a concentration of knowledges around the Information 
Units. Since the largest concentration of tasks focused on this 
product — which is a major component of one of the focal outputs^ — 
it seems appropriate that a concentration of enablers (in this case 
knowledges) would also be focused on this output. In addition, note 
that almost one-half of the skills cited in Table 4 are in relation 
to the Information Units. 

Keeping in mind the nature and intended use of many of the pro- 
ject’s outputs, skills related to writing seem to be critical. Link- 
ing these skills co the tasks and standards cited for the major outputs 
suggests the level of skill required. 

Senstivity to language barriers and needs of self and others 
are categi ries most frequently cited by those interviewed. Staff wel- 
fare is again emphasized with the necessity of being aware of others 1 
needs. Relative to the report manual, which is intendei for 
use by other writers, being sensitive and aware of language barriers 
seems to be crucial to ensure maximum utility of that product. 
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See Figure 3, Output Map. 



Chapter IV: Supplementary Data 



Data in this chapter are primarily derived from questionnaires 
submitted to project interviewees. included are data about output 
classifications, the backgrounds of interviewed project personnel, 
the job requirements for the project, and the support resources of 
the project. 



Classifications of Output Characteristics 

Outputs may be categorized in terms of a number of variables. 
Among them are (a) Structure (product, event, or condition), ( b Func 
tion (policy setting, management, or production), (£) Level focal, 
component, or facilitating), (d) Character (knowledge, technology, 
implementation, or information), and ( e ) Stage of completion. These 
five schema are represented in Table 7 for each project output identi 
fied, with frequencies summarized for each category. 



Summary of Staff Backgrounds 

Data concerning the academic and professional backgrounds of 
seven staff members were obtained. Two staff members had doctoral 
degrees, three had master’s degrees, and two had bachelor’s degrees. 
Their collective specialty areas were reported as follows: 

Psychology (Social Psychology) 

Communicat ion Research 

Education /Teaching/ Special Education 

French 

Pol it ical Science 

English/Writ ing 

Psychology/ Teaching/ Educat ion 

The work experience of the seven staff interviewed is summarized in 
Table 8. Interviewees were also asked questions pertaining to what 
prior training and education they had and what they thought was nec- 
essary for work on this project. All indicated that their positions 
required work experience in educational research, development, dif- 
fusion, and/or evaluation; work experience in administration; and 
work experience in management. The number of years work experience 
required in each of the areas as averaged from interviewees’ response 
are as follows: 

(a) Experience in R,D,D, and/or E - 2.4 years (average) 

(b^) Experience in administration - 2.0 years (average) 

(c) Experience in management - 1.5 years (average) 
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Classlf 1 cations of Output Character 1 st 1 cn 




















Output ('lull II 


iter 1 


lit !« * 










1* r uj r£t^Oujjiu t* 


Structure 


Function 


i Level 


.A'7 


t'linrai* ter 
tidin' tn unly) 


Ctimplei ion 


Si nite 


No. 


Untir 1 


per 


pet Ct 


p , 


*1 c *2 


k 


1 h 




1 2' 3 V 


' V* 6 ' 


P-01 


Initial ALERT Package (Keceipe Boa) 


X 




X 


X 




X 






X 


P-02 


Package Instruction Booklet (With 
Recclpe Box) 


X 




X 


X 




X 




X 




P-03 


ALERT Punched Card* 


X 




X 


X 




X 






X 


P-04 


ALERT Abstracts 


X 




X 


X 






X 




X 


P-05 


ALERT Summaries 


X 




X 


X 






X 




X 


P-06 


Telephone Record Form 


X 


X 




X 




X 




X 




P-07 


Summary Worksheet 


X 


X 




X 




X 




X 




P-08 


Card Worksheet 


X 


X 




X 




X 




X 




P-09 


Giant Card 


X 


X 




X 




X 




X 




P-10 


Card Preparation Manual * 


X 


X 




X 




X 






X 


P-11 


Summary Manual 


X 


X 




X 




X 






X 


P-12 


Style Manual 


X 


X 




X 




X 




X 




P-13 


Selection Manual 


X 


X 




X 




X 




X 




P-14 


Report Manual (For Writers) 


X 


X 




X 




X 




X 




P-15 


ALERT Reports 


X 




X 


X 






X 


X 




P-A6 


Information Unite 


X 




X 


X 




X 






X 


P-17 


Audio-Visual Materials for Information 
Units 


X 




X 


X 




X 






X 


P-18 


Scripts for Audio-Visual Materials 


X 




X 


X 




X 






S 


P-19 


Evaluation Reports 


X 


X 




X 






X 




X 


P-20 


Questionnaire^ 


X 


X 




X 




X 






X 


P-21 


ALERT Packages (Materials) 


X 




X 


X 




X 






X 


P-22 


Promotional Film Strip-tape 


X 


X 




X 




X 




X 




P-23 


Promotional Brochure 


X 


X 




X 




X 




X 




P-24 


Tape Script (Promotional) 


X 


X 




X 




X 




X 




P-25 


2nd Year Main (Performance Field Test 
Plan for ALERT 


X 


X 




X 




X 




X 




C-26 


Staff Welfare 


X 


X 




X 










X 


P-27 


Task Conceptualization Paper 


X 


X 




X 




X 




X 




P-28 


Monthly Narrative Analysis Reports 


X 


X 




X 






X 




X 


P-29 


Financial Analysis Reports 


X 


X 




X 






X 




X 


P-30 


Contractor's Request for 1971 Funding 


X 


X 




X 




X 




X 




E-32 


Main (Performance) Field Test of ALERT 


X 


X 




X 








X 




E-33 


Preliminary (Feasibility) Field Test 
of ALERT 


X 


X 




X 








X 




P-34 


Preliminary (Feasibility) Field Test 
Plan for ALERT 


X 


X 




X 




X 




X 




P-35 


lsi Year Main (Performance) Field Test 
Plan for ALERT 


X 


X 




X 




X 




X 




E-36 


Telephone Survey of ALERT in Main Field 
Test 


X 


X 




X 








X 




P-37 


Telephone Survey Plan for ALERT in Main 
Field Test 


X 


X 




X 




X 




X 




P-38 


Telephone Survey Questionnaire 


X 


X 




X 




X 




X 
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TABLE 7 CONCLUDED 

Classifications of OuCput Characteristics 



Output Cl 





Project Outputs 


Structure 


Function 


Level 


Character 
(Products only) 


Completion Stnue 


No. 


Label 


P 


a 


c 


pa a p 


<1 c 


k t ti tj 


1 2 


3 4 5 6 


P-39 


Telephone Survey Report 


X 






X 


X 


X 




X 


E-40 


Coat Survey of ALERT In Main Field Teat 




X 




X 


X 






X 


P-41 


Cost Survey Plan for ALERT in Main Field 
Test 


X 






X 


X 


X 


X 




P-42 


Coat Survey Queatlonnalre 


X 






X 


X 


X 


X 




P-43 


Cost Survey Report (In forma 1-Moatly 
Verbal) 


X 






X 


X 


X 




X 


E-44 


Sample Selection for ALERT let Tear 
Main Fiald Teat 




X 




X 






X 




E-43 


Operational FlalJ Teat of ALERT 




X 




X 


X 






X 


P-46 


Operational Field Teat Plan for ALERT 


X 






X 


X 


X 




X 


P-47 


let Year Main (Parforaanca) Field 
Teat Final Report 


X 






X 


X 


X 




X 


E-48 


Data Anelyele 




X 




X 


X 






X 


E-49 


Data Coding 




X 




X 


X 






X 


F-50 


Utilisation Plan for ALERT 


X 






X 


X 


X 




X 


P-51 


Eleaent Taatlng Inatruaanta 
(Queatlonnalree) 


X 






X 


X 


X 




X 


F-52 


MUeetone Schedule 


X 






X 


X 


X 


X 




C-53 


Coordinated Evaluation Teas In Main 
Field Teat of ALERT 






X 


X 


X 






X 


C-54 


Staff Morale 






X 


X 


X 






X 


E-55 


Heating of ALEUT Staff to dlecuee a 
Publisher’s Proposal 




X 




X 


t 






X 


C-56 


Conceptual Laadsrshlp for Project 






X 


X 


X 






X 


E-57 


Stef f airing 




X 




X 


X 




X 




P-58 


ALERT System 


X 






X 


X 


X 




X 


Claaalflcatlon Frequencies^ 


43 


10 


4 


1 45 11 


2 S 47 


0 28 6.9 


2 17 


y 

5 10 5 18 



ractar f at i c * 



1 Tba specific output charactarlatlca ere Identified as follows: 



Structure 

p - product 
a - avant 
c - condition 



Function 

pa - policy setting 
• - aanageaent 

p - production 



Larval 

<1 ~ focal 
c - component 
fj “ facilitating 



Character 

k - knowledge 

t - technology 
lX * Implementation 
12 * information 



Completion Stags 

1 - completed over ona year ago 

2 - completed 3 to 12 montha ago 

3 - completed irlthln laat 3 noa. 

4 - currently In prograaa 
3 - not yat underway 

6 - on going (contlnuoua) 



Data totals In this table aay vary ellghtly froa data la tablaa reported elsewhere . Thla Is a function of daclalon rules 
governing claaal Mention of outputa having bean revised and applied to thaaa data aubaequent to the preparation of the 
profile. 
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TABLE 8 

Summary of Staff Backgrounds 







Amount of 


Experience 


Total 


Work Set ting/ Context 
Category 


No. 

Experience 


Less Than 
1 Year 


1-4 

Years 


5 or 

More Years 


No. of 
Staff 


In R, D, D, or E Work 


0 


0 


5 


2 


7 


In Administrative Work 


3 


0 


2 


2 


7 


In College Teaching or 
Research 


3 


0 


4 


0 


7 


In Public Schools 


5 


0 


1 


1 


7 


In State or National 
Education Agencies 


6 


0 


1 


0 


7 


In R & D Centers 


4 


0 


2 


1 


7 


In Other Work Settings 


4 


0 


1 


2 


7 


In Present Organization 
(May be concurrent with 
other areas identified 
above) . 


0 


1 


5 


1 


7 



Concentrations of data in the above table indicate that 

(a) All interviewees had experience in research, development, 
diffusion or evaluation work, and 

(b) Most of the interviewees had no experience working in 
public schools and state or national education agencies. 
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Interviewees were asked, "What specific knowledges and skills 
does your position require?" Their responses were as follows: 

R&D management including personnel, organization, scheduling, 
contracts, proposal writing, and general supervision. 

Broad knowledge of social science. 

Specific knowledge of educational technology, evaluation, and 
systems development. 

Knowledge of research methodology. 

Management ability. 

Background in diffusion science (science of knowledge utilization). 
Knowledge of R&D methodology and procedures. 

General awareness of trends in curriculum and general education. 
Excellent writing skills — jargon free and educationese free. 

Ability to work well with people including leadership, 

firmness, consideration, and giving criticism effectively. 

General level knowledge of education, i.e., school organization, 
staffing patterns, curriculum selection and implementation. 
Strong research and writing skills. 

Aptitude for conceptualization and then implementation of 
models and systems for displaying processed information. 
Knowledge of math arid science curriculum. 

Knowledge of trends in elementary education. 

Analyt ical ability . 

Information gathering skills. 

Ability in writing for lay audiences. 

Ability to conceptualize systems and products. 

Ability to plan and carry out development and testing of products. 

Several interviewees emphasized the necessity of good writing 
skills — particularly the ability to write clearly with minimum use 
of jargon — so that the documents could be understood and used by a 
wide variety of people. 



Support Resources and Equipment 

Those support resources called upon by the staff and seen as 
necessary included : 

Equipment construction . 

Printing . 

Duplication services. (Xerox; audio reproduction) 
Photography . 

Art work and illustrations. 

Drafting. 

Technical writing . 

Kd i t ing . 

Secretarial service, other than typing. 

Typing. 
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Purchase of supplies. 

Library holdings. 

Subscriptions to technical and professional journals/periodicals. 
Requests for documents or publications not locally available. 
Computer analysis services. (data processing) 

Computer program writing. 

Statistical consultation . 

Audio-visual aides and devices. 

Subjects for experimentation or tryout of procedures. 

Travel arrangements . 

Budgetary and other fiscal accounting. 

Scoring of test items. 

Television facilities and equipment. 

Budget and fiscal projection-analysis. 

Contract monitoring. 

Speech writing. 

Public relations. 

Dictating equipment. 

Desk calculators. 

Desk-top computer. 

Photographic equipment. 

Readers for microfiche or microfilm. 

Filmstrip and audio tape preparation equipment. 

McBee card gang punch. 

MT ST/ typewriters . 

Copy machines. 

Tape recorder. 

Filmstrip projector . 

Carousel slide projector. 

Film projector. 

Battery charger. 

Telephone . 



Summary of General Position Activities 

By questionnaire, project personnel interviewed were asked to 
rate nine general activity categories on an eight point scale. The 
scale represents the significance of an activity in the respondent’s 
project work from 0 _, "Definitely not a part of my project activity, 
does not apply" to 7_, "A most significant part of my work." The 
rankings are listed by position/title over the nine categories in 
Table 9. 

It can be seen from Table 9 that the activity of "supervising and 
coordinating actions of others, and/or of material resources" occupies 
a considerable amount of time of each of the staff interviewed even 
though these positions are of considerably different responsibility 



TABLE 9 



General Position Activities Ratings 



Position/Title 



Ceneral 
Position 
Ac tiv it ies 


i 

Program 

Director 


Senior 
Program/ 
Pro j ect 
Assoc i- 
ate II 
(Acting 
Pro j ect 
Dir ec tor 


T 

Senior 
Program/ 
Pro j ect 
Assis- 
tant II 
(Task 
Manager) 


Senior 
Program/ 
Project 
Assis- 
tant II 
(Evalu- 
ation 
Team 
Leader) 


1 

Senior 
Program/ 
Project 
Assis- 
tant I 
(Task 
Manager) 




1 Program/ 
Pro j ect 
Ass is- 
tant II 
(Writer/ 
Ed itor ) 


Mean 

of 

ratings 


A. Reading 


3 


2 


5 


4 


4 


5 


3.8 


B. Designing 
or plan- 
ning pro- 
cedures ac- 
tivities for 
the project 


5 


6 


i 

4 1 


4 


7 


4 


5.0 


C. Developing 
research 
tools or 
other in- 
formation 
gathering 
ins trument s 


I 

2 


i 

i 

1 


! 

i 

3 


1 

5 


1 


3 


2.5 


D. Collecting 
pro j ec t 
data 


2 


0 


5 


i 

5 


3 


6 


3.5 


E. Analyzing 
data 


3 


1 


5 


5 


1 


7 


3.7 


F. Writing 


4 


4 


5 


7 


i 

1 4 


7 


5.1 


G. Supervising 
and coordin- 
ating actions 
of others, 
and/or of 
material re- 
sources 


6 


7 


7 


1 

6 


i 

1 

! 

6 


5 


6.1 


H. Teaching or 
training 


3 


4 


2 


3 

1 


0 


4 


3.1 


I . Meeting, 
consul t ing , 
or advising 


A 


6 

t 


5 H 


i'S 


1 

3 

■*- . . 


4 


4.7 

i- 
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level within the Laboratory. The other activities of "designing or 
planning procedures and activities for the project", "writing", and 
"meeting, consulting, or advising" also tend to be significant acti~ 
vities across these six positions. The spread of these significant 
project activities across staff at such diverse position levels in- 
dicate a participative management approach. This will be discussed 
further in Chapter V. 

From a list of additional miscellaneous activities the following 
activities were ranked as significant to very significant by at least 
one of the six staff: (<i) "editing and/or proofing of printed mater- 

ials," (b.) "determining constraints to problem solution, such as time, 
money, personnel, and market factors," (_c) "developing budgets for 
tasks of projects," (<d) "analyzing the nature of various audiences of 
publics* to prepare appropriate communications," ( e _ ) "conferring with 
colleagues, staff, and/or students," and (jf) "interacting directly with 
personnel of other agencies, such as for field tests, at trial learning 
centers for potential users of R & D products." The Program Director 
identified activities b, c, and e as a significant part of his work, 
while the Acting Project Director identified activities a, b, e, and d 
as significant in his work. Junior staff identified b, c, e, and f as 
significant in their work. 




Chapter V: Project Dynamics 



The work of ALERT is not in the strict sense a discrete set of 
activities that can adequately be identified as a project. Rather it 
is a complex of closely related and overlapping activities oriented 
around the fairly specific objective of establishing M a technology to 
process information about educational development." Of the three 
components of the Communication Program, most all the work of the 
Information Processing Component has been absorbed into ALERT, making 
this effort a multilevel activity. 

History of ALERT 



The goal which was identified for the Communication Program at the 
establishment of the Far West Laboratory for Educational Research and 
Development in 1966 was to "create an effective means of articulation 
between educational R&D and its potential users in the school by develop- 
ing a comprehensive and integrated system for both processing and using 
information." Within these limits, the Information Processing Component 
of the Communication Program set for itself the task of developing 
"information-processing system ’technologies* capable of providing 
specific information about educational developments." In this conceptual 
context the first information system, Information Units, was developed 
in 1967. The Information Units were designed as "packaged, mailable, 
multimedia, multilevel, comparative information about exemplary devel- 
opments in selected curriculum subject areas." Information Units have 
been developed in areas such as elementary science, secondary social 
studies, individualized instruction, early childhood education, and drug 
education. The initial units did vary in media and format; however, 
each provided three levels of information (survey, briefing, detailed) 
usually covering five to eight development programs in the selected 
areas . 

The Information Units were found to be useful in the school; however, 
as one staff member comments, "As we were developing these units we felt 
that they (the Information Units) were too confining in that they dealt 
with one subject area. (Each Information Unit dealt with a single 
subject, i.e., elementary science, without a general indexing system 
across all the Information Units.) We wanted an information system 
that was more comprehensive and global, that would allow the user a 
greater range of choice in subject areas." From what was learned in 
the development of the Information Units, conceptualization of a "second 
generation" information system was initiated that not only would incor- 
porate the information unit concept, but also provide a greater range of 
subject areas and more flexibility in use. In 1970 the design and field 
testing of the ALERT information system was begun. 

At the time of observation (June 1971), the development of the system 
had been underway for about one to one and one-half years. Initially 
the system was conceived as an information system at the elementary 
school level; however, exploration of the secondary level has begun, and 
the system will eventually, according to its developers, comprehensively 
cover both levels. 
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Beyond the information units, the conceptualization of the ALERT 
system involved the designing of information indexing and briefing 
components, as well as the technology for information collection, 
processing, and dissemination subsystems. A concept paper for ALERT 
was prepared by the Director of the Information Processing component. 

The ' conceptualization process was one where the Component Director 
held a series of meetings with five or six of the staff to discuss 
various ideas. These meetings were described as "brainstorming" 
sessions where the Director of the Component threw out ideas for 
reaction from the staff. The ideas from these meetings were written 
up and distributed to the staff, in general, for their reactions and 
critique. This informal, inhouse procedure seems to have been fairly 
characteristic of how the general conceptualization of ALERT was 
accomplished . 

The developers indicated that ALERT was in an "advanced prototype 
stage" at the time of observation: "we are just now completing," 

commented one staff member, "the ’main field test 1 which we started in 
October 1970. We installed ALERT in about 100 sites in five states. 

This included school districts and individual schools." 

The main field test (MFT) is one of three field tests (see the 
laboratory model) that the ALERT system development will go through. 

The others are a preliminary field test and an operational field test. 

During the MFT, pre- and post-questionnaires were used to empirically 
determine whether or not the system is meeting its objectives. Element 
(brief) questionnaires were used to gain information on a specific 
element’s effectiveness, and both a telephone and a cost survey were 
conducted. It is interesting to note that the development of a question- 
naire usually involves the use of items developed early in the project 
or developed on other projects. Thus, from this "pool" of items can be 
drawn the specific items needed to build a questionnaire. In many cases, 
little modification of an item is needed. 

The selection of the sample for the MFT was done through contacts 
that the Laboratory had in various states. Letters were sent to the 
board of education in each state asking them to locate a certain number 
of sites that fit certain criteria, i.e. ,, expenditure per pupil (high 
and low), isolated or rural-urban distinction. From these lists, the 
individual schools were contacted and asked to participate. The 
developers indicate that about 90% of the schools contacted agreed to 
participate . 

The preliminary field test of ALERT had been completed p^icr to 
the time of observation. It consisted of bringing a selected gr^up of 
people into the Laboratory to see the ALERT system as conceived, and 
collecting opinions by questionnaire about ALERT’s feasibility and 
effectiveness . 

At the time of observation, ALERT was in the MFT with the opera- 
tional field test yet to be accomplished. 




Organizat lonal Notes 
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The activities of ALERT seem to cluster by production, management, 
and evaluation. While evaluation tends to maintain considerable auton- 
omy, production and management tend to merge, especially at the junior 
professional levels. But within these work clusters, teams are formed 
as the basic organization by which the work of ALERT is accomplished. 
These teams tend to be composed of about three people. This team concept 
was used throughout the Communication Program and its various components 
as well as in the Information Processing (ALERT) component. Essentially 
all activities are accomplished by teams. For example, one team of 
writers may do reports, sort-cards, and summaries in special education 
and vocational education, or in early childhood education. Another 
team may be working on similar products, but in another subject area such 
as language arts — English or foreign languages. People in these groups 
tend to be individuals with background both in the subject area and in 
writing areas outside of education. 

A separate team conducts evaluations of all ALERT packages regard- 
less of subject area. This team consists of a leader and three members 
that include a "Program Assistant," a middle level professional position 
in the Laboratory; a "Research Intern,” the lowest level professional 
position; and a "Research Clerk." The Program Assistant provides backup 
to the team leader, the Research Intern does coding, interviewing, and 
may do some data analysis. The Research Clerk does all the typing, 
filing, handles correspondence, and various other jobs. 

The s taf f- t o-secretary ratio seems to run about two or three to one. 
Secretarial services, especially typing, are at times pressed to meet 
the needs of the professional staff. However, support services in 
general were reported as adequate. 



Management Style 

The management and organization of the ALERT effort has been 
strongly influenced by the Communication Program Director. This influence 
has become even more pervasive with the loss of the former Information 
Processing Component Director and conceptual author of ALERT. At the 
time of observation the ALERT component was managed by an acting director. 
A newly appointed director was due to assume leadership shortly after 
our visit. 

The management style throughout the Communication Program, as well 
as in ALERT, is a participatory management approach with responsibility 
being delegated at the various levels and problems and decisions being 
handled on a team basis at those levels. These levels include the 
Program level, the Component level, a mid-level in the Component, and 
a task level. Information flow is accomplished by participation in 
meetings, etc., of a liaison staff member from each of the levels, and 
by regular reports from these staff members. This procedure allows a 
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in mil >1* r oi stair to become involved in management activities along the 
vertical dimension of the staff. This requires management ability 
across the staff and a willingness to allow decisions to be made by 
a team at the level at which problems occur* This approach would seem 
to eliminate many of the lesser concerns or problems that top manage 
ment would otherwise have to contend with, while sponsoring more and 
broader staff participation in management* but this could also lead 
to isolation of the various levels, and reserve to top management only 
the more important or significant considerations* 



Communication and Reporting 

Communication within ALERT and at the program level generally seemed 
to occur informally* Some of the meetings were regularly scheduled, 
serving as update sessions* Generally it is understood that an open 
office door means that that staff member is receptive to visits from 
otlv^r staff* 

In reporting, the most formalized procedure used is a ’’narrative 
analysis*” This report is prepared by the team leaders/task managers 
at the task level* These one page progress reports are written monthly 
and insure information flow to the Component Director and the Program 
Director* 

The ’’narrative anlysis” is a management tool that has been insti- 
tuted to help in the monitoring of ALERT, ^s well as other work in the 
Program* A one page '’planned/actual expenditure report” was being ir. - 
tiated at the time of our observation* This would be prepared at the 
task level and updated monthly* Also, at the time of our observation, 
there was talk of a ’’reverse narrative analysis” that could be prepared 
by the Program or Component Director* However, this was yet to be re- 
alized* Consequently the downflow of information was less well estab- 
lished and occurred mostly in meetings which tended to be called on an 
irregu 1 ar basis * 

One staff member summing up the communication and reporting process 
indicated that ”we have meetings of the whole component staff from time 
to time when there are specific problems* We no longer have regular 
staff meetings* We are supposed to report once a month on our activities/ 
program for a specific task*” 

Most all the reporting, formal and informal, at the agency level, 
inhouse and out, seemed to be primarily the responsibility of the 
Program Director* However, the Program Director indicated that the 
staff is encouraged to represent their projects before various public 
audiences and at professional conferences* 



Physical Setting 

The offices of the Communication Program wl ere the work of ALERT 
is being conducted are located in dcwntown Berkeley* Th^ location of 
the offices seems fairly accessible* Auto parking facilities are 
located nearby* The University of Califor xa at Berkeley campus is 
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just a short distance. The main offices of the Laboratory are about 
a mile from this location. The Communication Program occupies most of 
the Lh.it*d floor and part of the first* floor of the multistory stone 
building in which i.t is housed. The first floor is shared with another 
program of the Laboratory and with library facilities. The offices of the 
evaluation team for the Communications Program and a mail room are on 
the first floor. On the third floor are the offices of the writing 
teams and management of the ALERT component and the Communications 
Program. The offices of staff employed in the other components of the 
program share this floor. 

The decor of the offices varied a great deal, from carpeting and 
wood furnishings to tile floors and institutional furnishings. T he 
furnishings, other than a desk, usually included one or two chairs, 
a book case or two, and file cabinet. All offices had at least one 
window. Lighting was florescent. The size of the offices varied 
considerably. In fact, a shortage of office space forced many of the 
staff either to be doubled up or to be officed in a large central area 
of the third fl%^ that was partitioned by portable dividers. It was 
mentioned that the^only space left for new staff was the conference 
room. 



iue conference room occupied a part of the space available on the 
third floor. It was a fairly large room, carpeted and furnished with a 
large table and chairs. At one end of the room was a blackboard. The 
room had several windows, with the electrical lighting being florescent. 
The conference room was very convenient to all the offices on the floor, 
and was scheduled through the Program secretary. 

All in all the physical setting seemed to be very adequate, but 
limited space was a problem, especially in maintaining some 
privacy for such tasks as writing. The street and traffic noise 
tended to be noticably loud at times. 



Policy 

Probably the most significant policies affecting the work of ALERT 
are those set at the program and Laboratory level. However, within 
ALERT some policies such as the following production procedure have 
become somewhat formalized: 

1. Rough draft written. 

2. Typed rough draft. 

3. Writer reviews rough draft. 

4. Rough draft is proofread by proofreaders for style. 

5. Component Director edits draft for content. 

6. Draft returned to proofreader for second style edit. 

7. Final draft typed. 

8. Writer reviews final draft. 

9. Any corrections necessary are made. 
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In a sense, too, the technc^ogy that Is be in>; developed in ALLEY 
certainly J. s .liTeet the methods and procedures of the* development 
itself. formats, styles, and content are specified. 

Some policies at the program and/or Laboratory level that alieci 
ALEE* 1 * ana its people Include: working hours from 8:30 n.ni. to 3:00 p..,u 

arc expected of professional and required of nonnrof essiotriL staff, ‘'he 
Lahore tory operates jn the PPBS system; necessitating that all stall 
fill out time cards each two weeks to provide information as to which 
budgets to charge time against. There is considerable paper work 
necessary in making various requests for such things as equipment, mater- 
ials, or travel. Each staff member is responsible for his own paper work. 

When a money shortage occurs, notices of job terminations are made 
to the professional staff three to six months before termination. 

Hiring re commend a. *‘ons are usually made by the managers ai. the level 
for which the applicant is being hirwd. Of course, the higher the level 
in the program the mere influence the Program Director has in the hiring 
process. It was indicated by the Component Director that minority 
applicants are given additional consideration in the screening process. 

The development process in ALERT is greatly effected by Laboratory 
development policy- Rather systematic documentation of work in a program 
is required early in a development. For example, in ALERT, as the 
initial conceptualization and design was being a complished, a concept 
paper was prepared and submitted to the Program Director for review. 

Only after this paper was approved by the Director and significant 
others was work in ALERT allowed to proceed. If it nad ac . been 
approved money would not have been allocated for the development. 

At the conclusion of a preliminat / development and testing stage the 
field test and work program is documented and submitted to the Program 
Director. Approval is necessary for continued work. 

This procedure is the initial part of the generic model of develop- 
ment that has been adopted by the Laboratory (see Appendix Bl . 



Issues 



The process of ALERT has been greatly effected by several factors 
with which the development and its people have had to struggle. But 
probably the most pervasive influence has come as a result of the 
reorganization of the Communication Program. The components of the 
program were being given program status while the program was taking 
on a divisional status. Apparently the reorganization was a response 
on the part of the Program Director to the need for more efficient 
management structures required by the large (almost 50) staff and many 
projects in the program. Given these influences along with the manage- 
ment style, discussed earlier in this chapter, some middle level staff 
moved into positions of management responsibility for which some, as 
they indicated, were not prepared. 
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Other factors such as loss of the conceptual, author and Director 
of ALERT seem to have been a very important influence. Staff at the 
various levels seem to be adapting to the reorganization at differing 
rates. 

Some very positive influences on ALERT and the whole program are 
the presences of a "hard money" funding base which allows the kind of 
systematic planning, development, and stability that is essential to 
an integrated eflort. Also of significance here is the development 
philosophy of the Program Director whose notion about how one goes 
about producing a product reflects a tradeoff among blind step-by- 
step following of a procedure versus a system-design sampling approach 
versus a cost-effective strategy. All of this is strongly reflected 
in ALERT. 
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Chapter VI: Implications for Training 



Within the ALERT Project, two primary skill orientations emerge. 
Some of the staff members are primarily journalists while the remainder 
are primarily educational developers. The melding of the two orienta- 
tions provides the major training implicati a found in this project. 

Those staff members with a primarily journalistic background made 
it quite clear that people engaging in educational development / d i f fu- 
sion should be trained in journalistic style writing. Their rationale 
for this position indicted a belief that educational ..a* elopers/dif- 
fusers tend to rely upon jargon or "educat ionese" to the extent that 
understanding and acceptance of their products outside the R&D com- 
munity is impaired. 

Those staff members with a primarily educational development back- 
ground appear to agree with the journalistic writers, at least in prin- 
ciple. Without exception, these staff members appeared to accept the 
value of the journalistic approach in the writing and speaking portions 
of their outputs. Some of the educational developers were becoming 
proficient at journalistic writing, while others preferred to depend 
upon the journalists for interpreting and rewriting their outputs. The 
need for training to achieve proficiency in the area of journalistic 
style writing was quite pointedly expressed by a majority of all staff 
interviewed . 

The team approach which was used throughout this project was fre- 
quently mentioned as an area which should be emphasized in training. 
Operation as a team was seen by interviewees as not only bringing an 
area of expertise to the team effort, but also a mutual consideration 
of and commitment to the team’s goals. It was indicated that even 
the strongly individualistic staff member must effectively participate 
as a team member. 

Generally, across the staff, skill in managing was identified as 
an area in which personnel felt the greatest deficiency. The organiza- 
tional pattern of dele ing management responsibilities to the lower 
echelons has resulted some staff members expressing a feeling of in- 
adequacy. An implication is seen here that training of R&D personnel 
should include work in management techniques. 



Appendix A: 



Listing of Output Standards, Tasks, and Enablers 



The following is a list of standards, tasks, and enablers for out- 
puts around which interviews were conducted. There statements were 
elicited frori discussions with interviewees and were coded into their 
respective category sets. The selected code precedes the statement and 
indicates the following for: 

STANDARDS 



Code J: 


Structure of Standards. 


J-l 


Standards against which outputs are judged. (output 
oriented) 


J-2 


Standards against which processes and/or operations are 
judged. (process oriented) 


Code LM: 


Primary Categories of Standards. 



TASKS 



Code NO: 


Clusters of Tasks. 



ENABLERS 



Code S: 


Structure of Enablers 


S-l 


Knowledge . 


S-2 


Skill or ability to perform. 


S-3 


Sensitivity or awareness. 


Code UV: 


Primary Categories of Enablers (knowledges, skills, or 
sensitivities) . 



The codes associated with these three categories (standards, tasks, 
enablers) are the same both here in the listing and as previously cited 
in Chapter III tables. 

Each of the 10 analyzed outputs is cited below within a rectangular 
box. Listed under each are the interview statements relevant to that 
output . 



P-01: Initial ALERT Package (Recipe Box) 



"Essentially this is a box of cards and a box of summaries. The 
box of cards includes an instruction booklet and a knitting needle used 
to sort the cards (edge punched cards) according to the categories around 
the edge of the card which are explained in the instruction booklet." 



STANDARDS: 

J LM 

1 07 Team members subjectively approve their own work. 

1 01 High quality of analysis (completeness of description) . 

1 13 Team leader's supervisor approves all materials to be included 
in ALERT Package. 

1 24 Appropriately worded for target audience. 

2 14 Team leader subjectively approves subordinates work. 

TASKS: 

NO 

01 Study field (ed. journals, foundation supports, USOE project re- 
ports, etc) to identify potentially usable developments (within 
assigned subject matter areas). 

01 Study detailed materials sent by developers. 

03 Determine, from development complexity, what kind of materials 

to write (least complex-only card, most complex-card, summary and 
report) . 

03 Identify items (descriptors) to be punched out of edge of card on 
giant card. 

03 Identify items (categories) to be edge punched on master card. 

04 Select developments for inclusion in ALERT. 

04 Use card worksheets to assist in preparing card data and abstract. 

04 Use summary worksheet to assist in preparing summary. 

04 Prepare materials in set format. 

04 Write abstract within card limits. 

04 Write summary within four-page limits. 

04 Prepare cost sheet data for summary. 

04 Type card data, abstract, and summary in proper spacing for printing. 
04 Duplicate 500 copies of card in (inhouse) final form. 

04 Punch all cards according to master card. 

04 Print 500 copies o_ ; summary and/or report. 

05 Identify master card with accession number. 

06 Proofread proof copy. 

07 Produce ALERT materials to explain ALERT. 

07 Send cards to buyers on a monthly basis. 

07 Send sumnary (with card) to buyer on monthly basis. 



22 Assign developments to team members for detailed study. 

22 Assign team member to write ALERT package. 

22 Send master copy (after proofreading) of summary or report to 
commercial printer. 

24 Select developments for further study. 

24 Monitor writing progress to achieve time line. 

24 Review and/or approve cyped copy (supervisor). 

24 Proofread and/or approve typed copy (team ’ eader). 

26 Guide writer by editing and suggesting improvements as work 
progresses . 

29 Send ALERT brochure and A-V presentation to developer to describe 
ALERT . 

30 Write developer to obtain project materials. 

ENABLERS: 

s uv 

1 03 Practical curriculum development (knowledge). 

1 06 Current practices in schools in various subject areas. 

1 06 Educational trends. 

1 03 Introductory knowledge of research evaluation. 

1 02 Introductory knowledge of statistical methods. 

2 08 Ability to study and learn in order to gain knowledge in deficient 

areas . 

2 14 Ability to write in magazine style. 

2 18 Ability to judge if tests performed were appropriate. 

2 32 Skill in editing. 

2 17 Skill in translating educational terms into items meaningful 
to "even the man on the street." 

2 24 Clearly stating what (work) is expected. 

2 24 Clearly stating how to go about doing work. 

3 52 Sensitive to team members interests in assigning work. 

3 31 Sensitivity to logical continuity in writing. 

3 41 Intellectual curiosity. 

3 19 Sensitive to achieving a balance between guidance and freedom. 

3 55 Consideration for other people. 

3 17 Understanding of different personalities. 



I 

P-14: Report Manual (for Writers) 



"The Manual contains both general instructions for the experienced 
writer and more detailed instruction with examples for less experienced 
writers in the preparation of rather detailcJ program descriptions which 
we cal J reports." 



STANDARDS: 



J LM 
! 05 



1 1 ? 
1 05 



1 05 



1 05 



1 05 
i r 
1 22 

1 05 
1 22 



1 23 

1 04 



1 11 

1 04 



Minna! had t p have utUltv for or bo equa'ly servic.ihle f*i* 

(Laboratory^ writers as well as Che intended users »■' 
manuals Oreo lance »nd educational writers). 

Manual rot too prescriptive. 

Manual was general enough so that a writer could generate a 
report about a progran/curr iculum from almost any field cr cutject 
matter area. 

Manual is complete in that there are enough directions and ex- 
planations within it that will enable the writer to describe the 
program/curriculum clearly and adequately for public school 
personnel to get a good idea of what the program is about and 
how it might fit into their school context. 

Manual is useful to n variety of audiences — educators who are 
not particularly good writers; writers who are not oriented i.n 
the field of education, etc. 

Practical and convenient to use. 

Acceptance by consortium members. 

Acceptable reports are produced while using the manual (both 
internally and by consortium members). 

Manual is useful to intended user/target audience. 

Manual (its content) will enable a writer to elicit the necessary 
information to describe new curriculum developments/programs 
correctly. 

Manual will not bind or stifle a writer. 

Language/ terminology in the manual is understandable to the user 
audience (writers) — language is clear, simple, and not too 
jargonized , 

Manual is of adequate length — not too long so it doesn’t frighten 
the user audience or overburden him with too many examples. 

Style in which the manual is written is uncluttered (to prevent 
too manv ideas crammed into one or two sentences), simple, and 
flows well. 



TASKS: 



NO 

04 

04 

06 

06 



06 

06 

06 



06 



Include (in writers 1 manual) reasons as to why it is necessary to 
explain or make clear to the reader certain aspects of the program. 
Add somv. admonitory materials to the text of the manual, i.e., 
admonitions and advice for the writer which he may or may not use. 
Edit and rewrite most of the manual sections. 

Evaluate the effectiveness of the language and terminology in the 
manual on the basis of whether or not a free lance writer was able to 
use the manual. 

Change the tone of the manual from one of patronizing/rigid/overly 
prescriptive to one of flexibility. 

Eliminate or reduce the "ordering 11 language — "do this/do that." 

Change the format somewhat by putting in capital letters a brief 
order statement which is followed by an explanation of why the 
wxiter is doing this (this explanation was in lower-case sentences). 
Attempt to place more reliance on the intellectual and analytical 
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powers of the writer himself by giving a brief explanation of the 
"do" or "order" statement. 

Rearrange the original order ot some of the elements within the 
manual . 

06 Reduce the amount of material that leads the writer to describe 

the history of the development of a particular prog^am/cur riculum . 

06 Clarify and add further explanations to sections of the manual 
that will enable the writer to present clearly some of the more 
important aspects of a program/curriculum. 

02 Conceptualize manual as a checklist- type . 

02 Confer with professional writer to gain writer's point of view. 

03 Conceptualize instruction manual to utilize loose-leaf checklist. 

03 Reconceptualize into one workbook with checklist items, general 
statements of requirements and guidelines, and examples of style. 

05 Test loose-leaf checklist manual while preparing reports for 
information unit. 

05 Test instruction manual by using while preparing reports. 

05 Test report manual by team members using it in writing report 

06 Judge efficiency of two manuals. 

04 Write or produce a draft. 

06 Revise (rewrite) the draft based on some of the more Jegitimate 
criticisms . 

22 Assign a staff member the task of writing or revising the manual. 

22 Establish a deadline date for completion of the manual. 

24 Review the draft. 

24 Edit /critique on the basis of the practicality and usefulness to 

those who will be using the manual — intended users/target audience. 



ENABLERS: 

1 uv 

1 07 Knowledge of the ALERT System and materials that were being produced, 
e.g., cards, summaries, reports. 

1 08 Experience in dealing with curriculum materials and programs in 
trying to write a report and a summary. 

1 08 Know ALERT requirements for reports. 

1 24 Know how a trained writer operates. 

2 14 Skill in writing acceptable reports about developments. 

2 14 Skill in professional magazine writing. 

3 15 Sensitive to how much latitude a writer should be allowed in order 

to express himself. 

3 13 Sensitive to making writing understandable to public. 

3 02 Hjw much guidance a trained writer needs. 

1 19 Knowledge of general educational terminology and "inhouse ’ jargon 

so can tell when a term or phrase has been invented and/or used only 
within the agency and should be deleted from the text of the manual. 

1 04 Knowledge about learning theory, particularly in the models of 
cognitive development, e.g., Piaget's formulations about the 
maturation and development of the intellect; Gagne's hierarchies, etc. 

1 01 Knowledge of correct (English) sentence structure and syntax. 

2 08 Ability to analyze curriculum or an educational development. 



VtfO 



2 I H 'I he abiiir t<> judge whether c*r ru . «.* purliti.lur appr ku*i 

(spuuisKu .it the manual) will allow the writ*, t o elicit »..* 
necessary ir.ionnation needed to describe an eibn.a in i.t I p: oy • • • 
deve j opment 

‘.2 -vi> 1 1 ! t * to U' ; Lt-w and edit with ^oi.ic Curii«*eire .m.J e* u t .«. > .. ■*. 
v • . • * • . l ' a s r. Mi* vt* t • i v a L i ■ 1 1 * ugl. t'. ( |'c i 1 o ni • 1 • « r , * 1 e * i- > /u a i ■ * 
luuc ■*. ti'u.al field. 

3 13 Sea.i i.t i 1 . e to Lite use of language and now educational jarg^.i * 

hamper uin’erstano uig . 

3 27 Sensitive to esthetic quality of writings. 

1 24 Understanding of how much work is involved in writing a report 

and trying to elicit all the necessary information about a program 
from the TaateriaJ s/ inf orir.ation available and open which thf r iporr 
is based. 

2 14 Ability to write clearly enough so that members outside or or. the 

ptr f phdy of the target .icdierKC will be able tt understand v/, at ha •» 
been written. 

3 30 Sensitive to the audience for which the manual is intended (w. leers.) 

as well as the eventual ’’sers of the reports (public school per- 
sonnel) . 

3 16 Awareness of the difference between the goals of a professional 

writer and the goals of an educator or professional (of any type) 
who writes; a professional writer seems to be more sensitive to 
the reader and what lie has to know* whereas most other prof ec-oionaJ ; 
who do some writing are primarily concerned about the material. 

3 22 Sensitive to or a keen appreciation for the turn-off point oi 

a reader — a reader can be lost at almost any word, so a professional 
writer's sensitivities are geared to keeping the reader interested. 

3 13 Sensitive to the language that was used in the manual. 



P-16: Information Units 



"It is a huge box that has some introductory information in it, 
that is an administrators guide, and in the Clementary Science Unit 
are six programs presented. Each program is treated as a report and as a 
filmstrip. In additiv i to tudt, there is an introductory filmstrip to 
tie the thing together. That is packaged together as a unit. Then there 
is another box for Individualized Instruction, another for Social Studies, 
etc." (Note: Information Units do vary in format and not all are multi- 

media packages. For example, the American Government Information Unit 
is produced only in a printed format or book form.) 



STANDARDS: 

J LM 

1 11 Program or curriculum development in unit has been reasonably well 



1 33 
1 11 



1 20 

1 06 

1 05 
1 28 

1 21 
1 18 
1 18 

2 04 



TASKS : 

NO 

01 



01 

01 



01 

01 

05 

30 



01 

01 

01 

03 

04 
04 
04 
06 
06 
07 
22 
22 



Programs Included in units are representative of the various 
trends within a general subject matter area. 

Programs (educational developments) included in unit have been 
selected on the basis of stated selection criteria r a number of 
steps of research and development — needs analysis has been done, 
prototype, testing, etc.; availability). 

Final product (information unit) has withstood several development/ 
field testing „ycles. 

Approved by user-type people (representative sampie) . 

Meets user needs for -i. formation to assist in decision making. 

Users can operate (use) materials without supervision or explana- 
tion. 

All developments have been treated objectively. 

Attractively presented . 

Attractively packaged. 

Completed within time lines. 



Identify new programs/ cur riculum developments in particular subject 
matter areas by surveying R & D centers, laboratories, journals, 
and in advertising. 

If possible, visit teachers who have implemented the new program in 
a particular school or context. 

Review the materials of the program, e.g., read instructions to the 
teacher, examples of lessons within the program in the teacher 
materials and student materials. 

Attempt to determine what the classroom pattern of the program is 
likely to be. 

Determine how the specific program relates to the context of a 
movement or trend within the general subject matter area. 

Classify programs/curriculum developments according to the najor 
trend/movement of which it has some characteristics. 

Contact the developers for additional information about new programs/ 
curriculum developments that is not available in the printed infor- 
mation materials. 

Identify developments by searching journals. 

Visit one of sites recommended by developer which employs his devel- 
opment . 

Observe development in operation. 

Conceptualize A-V requirements to illustrate development (if 
appropriate) . 

Select developments which meet stated criteria. 

Write "reports" of developments. 

Film A-V presentation on site. 

Revise and reshoot A-V presentation if required. 

Revise (rewrite) prototype reports if required. 

Advertise units for sale. 

Chart time lines for production efforts. 

Monitor expenditures against budgeted funds. 



i n 1 



22 
2 2 
22 
"3 

2 3 

23 

24 

24 

24 

29 

30 
30 



r.N\BLERS 

S LTV 
1 06 

1 06 

1 06 

1 06 

2 OS 
2 27 
2 49 

2 1C 

3 10 

1 02 
1 03 
]. 02 

1 03 
1 06 
1 06 

2 19 
2 49 
2 20 
2 14 
2 32 
2 19 
2 45 
2 39 
2 10 
2 34 
2 21 
2 42 
2 11 
2 22 



Oll—f payments lor published material. 

Write progress reports at appropriate time. 

W‘i**o fi*.:el repi rt (of tcvjn responsibi J Lt ios) . 

f'cordJmtc with pot on in) publishers for mass production anO 

market ine of unit. 

Contract w»th ^n.lisl:er produce according tu spec i £ ic.u. . . 
orange for or. site t liming of devr lopments . 

Agree w.: tn developer tnac his development is adequately dusci'* ‘ .d 
and/or illustrated. 

Monitor work progress according to time li^es 

Monitor use of units in field by telephone interview or correspondence. 
Review prototype A-V presentation with developer. 

Identi'y developments oy conferring with colleagues. 

Contact developer by pnone or correspondence to obtain more detaileu 
information on development. 



Knowledge of major trends or movements within th^ general subject 
matter area in which one is working. 

Knowledge of the charac teristics of these major trends in a general 
subject raatter area. 

Understand the publishing (educational materials) business in terms 
of the techniques used in selling materials. 

Know the major publisher of a subject matter area. 

Ability to analyze. 

Ability to use some of the current information systems like ERIC. 
Rapport or personal relations skill in working with a librarian. 
Ability to file or organize identified programs and materials. 
Awareness of the hierarchy of cognitive skills within a subject 
matter area. 

Educational psychology. 

Research methodology. 

Statistics. 

Curriculum development. 

Knowledge of new developments in education. 

Knowledge of trends in education. 

Management capabilities . 

Interact with people effectively. 

Juuge eft ecti\eness of a development by observing it. 

Ability to write clearly in terms meaningful to use. 

Ability to edit other’s work (writing). 

Ability to visualize A-V presentation of ideas. 

Ability to evaluate your own efforts. 

Ability to construct questionnaires. 

Ability to analyze data. 

Ability to coordinate the efforts of the team. 

Ability to monitor adherence to time lines. 

Ability to involve users in conceptual efforts. 

Skill in treating all developments objectively. 

Skill in budgeting time and money. 



\ 



'S i 



2 33 Sk'.ll ir charting work efforts (PERTing). 

2 14 Sk. 1.1 ir writing proposals. 

2 .19 Skill mi conceptualizing your own organizations’ capabilities in 
light of recognized national need. 

2 08 Ability to read profusely to keep up with correct developments. 

3 02 Perceptive of peoples’ problems. 

3 25 Ability to maintain effectiveness of team of differing kinds of 
people . 

3 03 Sensitive to what users need to know to make dt cisior.o . 

3 18 Sensitive to not ’’selling” any one educational development yet 
promoting results of R & D. 

3 38 Sensitivity to priorities of national needs education. 



P-25: 2nd Year Main (Performance) Field-test Plan ror ALERT 



. .rewriting sections of last year’s test plan to extend it into 
a two-year test instead of a one-year test as originally planned. This 
is simply developing tentative plans for procedure next year to test 
various goals. . .” 



STANDARDS: 

1 LM 

1 22 The plan provides in implementation the kinds of data necessary 
to make the specific comparisons designated. 

1 17 The proposed data analyses are compatible with the type of data 
(nominal or interval) generated. 

TASKS: 

NO 

01 Review statistics books to plan data analysis. 

01 Review initial one-year main field-test plan. 

02 Discuss with evaluation team member the test sample subjects 
to get ideas of what testing procedures will be possible with 
the subjects. 

02 Discuss with supervisor the possible different forma's for the 
dissemination system we are building that we will want to test 
in the field in the second year of our main field test. 

02 Determine specific field test goals for second year extension 

of field test by discussion with evaluation team and supervisor. 

03 Think-up procedure to test each goal or objective by data 
comparisons, such as one-year users vs. two-year users. 

03 Set tentative standard for frequency counts — about 80% of the 
subjects should get scores of 80% or better on questionnaire. 

• r 5 



9S ‘4 



f’ 3 Write initial draft of test plan in long hand and have* secret m'v 
type . 

04 I'rc a memo prepared by supervisor outlining his expectations 
for the extended field test in writing the extended lield te : '. 
pi an . 

04 Rewrite test plan two or three times based on comments and 
suggestions of others from meetings and discussions. 

06 Discuss with supervisor and others possible revisions to draft 
of test plan in one or more meetings. 

24 Send typed draft to supervisor for review. 



ENABLERS: 

S UV 

i 03 Knowledge ~ 1 designs that exist such as Lhe quam-exper imental 
design ' in Campbell and Stanley (bool;) and what kinds of 
analysis techniques can be used with them. 

1 03 Aware of which evaluation/research designs have what deficiencies 
such that analysis results may be ambiguous due to the nature of 
the design. 

1 04 Have understanding of learning and attitude change to facilitate 
devising techniques for measuring them. 

1 22 Have understanding of information systems — mechanized systems 
such as ERTC — how they work and their purposes and uses. 

1 03 Knowledge of research methods generally used in social sciences. 

1 03 Know statistics both parametric and nonparametr ic most used in 

social science research and data analysis procedures. 

2 12 Able to use computers in data analysis. 

2 10 Able to interpret results of testing in sample (depending on how 
sample was chosen — at random or purposive — and the implications 
of those results for the total population. 

2 10 Able to compute statistical means, standard deviations, correlations, 
and Chi-square. 

2 33 Able to develop testing instruments, especially questionnaires thaL 
meet specified testing goals. 

2 14 Able to write so that people can generally understand what you are 

saying and so that it is grammatically correct. 

3 24 Anticipating where f, testing effects 11 may occur in a testing program. 



C-26: Staff Welfare 



*'• • 'tactic has been to 
or diffuse the authority very 
the task managers report once 



give them (staff) responsibility. . .to disperse 
broadly. . ,we have a monitoring system and 
a month on their activities and progress." 



6 



V 



STANDARDS : 



“S s 



J LM 

2 05 Staff members are able to do their job — they do produce the 
specified outputs or products. 

2 02 Staff members communicate their satisfaction with the job and job 
condi t ions • 



TASKS: 



NO 

22 Give the staff some responsibility (ies) . 

22 Disperse or diffuse authority on a broad basis. 

22 Organize staff into task groups — each staff is responsible for and/or 
a member of one or more task groups which is headed by a task 
manager . 

25 Uphold/encourage an "open-door" policy— available to talk with staff 
almost anytime. 

25 Plan occasional social get togethers among the staff. 

25 If a staff member is unhappy or bored with a particular task or job, 
attempt to work things out so he/she can move into another position. 

26 Distribute some of the "goodies" among the staff, e.g., opportunity 
to attend a meeting or convention, etc. 

27 Attempt to facilitate staff privacy where necessary — for example 
among the writers. 

27 Move the Director’s office close to where most of the staff are 
actually working. 

27 Group some staff together in a set of rooms to facilitate inter- 
action and necessary coordination — for example, the production staff. 

29 Support or assist staff as much as possible. 

29 Conduct management of staff in a very informal, low key style or 
approach. 

30 Set up monitoring system by which task managers report once a month 
as to the activities and progress of their particular task group. 



ENABLERS : 

s uv 

1 28 Understand the kinds of transactional games that go on between 
and among people. 

3 17 Aware of the structure of staff personalities. 

3 18 Understand elements like ego strength, threat, etc. and the 

implications of these elements in a situation where people are 
working and interacting with one another. 

3 30 Sensitive to the notion that most people like to understand how 
their job contributes to the whole. 

3 03 Sensitive to the notion that when a person produces something he 
likes to feel as if someone recognizes his efforts. 

3 03 Sensitive to the notion that most people want to be respected as 
human beings and that one is interested (not necessarily in 
agreement with) in their ideas. 

3 02 Sensitive to individual staff problems outside of his work, e.g., 
family problems, etc.). 







i 1)3 



Scnsit ivl' to the notion t.rmr. nost people i ike* to know thnt. v i n : 
w.M talk to them about something besides business iccasMcia * 



C-54: Stafl Morale 



"You have to be loyal to your people it you're going to allow tnem 
freedom in their work. You have to stick behind them hec.nrsr you th;U 
are ultimately icsponsible tor any mistake or mishap. . ." 



STANDARDS: 

J LM 

2 18 People hired to staff team are chosen by team leader. 

2 46 Staff have freedom and independence to determine own work schedule, 

2 25 Work responsibilities are mutually agreed to between team 
leader and team member. 

2 25 The staff members trust each other. 

2 33 The staff - embers are learning new things en the job that 
contribute to their vocational progress. 

2 44 Staff willingly accepts responsibility for their work. 

2 45 Staff effectively uses resources of time and money in getting 

work done as measured by comparison of what is produced against 
amount of time used and budget expenditure. 

2 10 Staff members participate enthusiastically and are "involved" in 
staff meeting. 



TASKS: 



NO 

21 Hire people that (I) want to work with. 

22 Depend oa staff to regulate own schedules to be at work and 
complete work in reasonable amount of time. 

24 Talk with staff member about problems when work is not satisfactory. 

25 Give my staff as much freedom in their work as possible by not 
imposing an overly strict time schedule. 

26 Provide feedback on adequacy of staff members work (reports) from 
what is known of higner managements expectations in their work. 

26 Provide a general nonauthoritarian approach to supervision of staff 
because fits personal style. 

25 Sort of preach to my people that they are the most important thing 
in this business. 

25 Handle personnel problems 'hat can not be de~lt with at the team 

or component level by discissions with all staff involved, both one 
to one and in group. 



20 lake considerable time to make sure new senior staff member (new 
program/ pro j oct director) will get answers to his questions as 
quickly as possible by personally briefing and assisting him and 
by having other staff do the same. 

3 3 Decide on appropriate action to be taken on personnel probletrs 
after discussions with staff involved. 



ENABLERS 
S UV 

1 21 Knowledge of management procedures with small groups. 

1 28 Knowledge of interpersonal relations and small group dynamics. 

2 34 Skill in personnel supervision from management or business point 

of view. 

2 29 Skill in counseling with a staff member concerning problems in 

work qua 1 i ty or quantity. 

3 37 Willing to give to staff responsibility for doing tasks and not 

worry about it. 

3 58 Loyalty to your staff to support their work when you allow them 
much independence in their work. 

1 10 Knowledge of people working in an R & D setting gained through 

17 years experience in production and management in educational 
R & D . 

2 02 Able to build and maintain mutual respect among staff. 

2 05 Able to chart a task or work activity against a time line but only 
to the degree appropriate to the work so that the time line is 
facilitating of production and not an end in itself. 

2 34 Able to keep staff work progress reasonably close to schedule 

and budget expenditures within limits, but not emphasizing these 
to the point that they are overly restrictive. 

3 37 Allow staff to do some things their way even though may disagree — 

not always insisting on my way in doing something. 



~ j 

E-55: Meeting of ALERT Staff to Discuss a Publisher’s Proposal 



M At that particular meeting there were about 10 of us there. We had 
been sent a memo on the RFP (request for proposal) before the meeting* . . 
During the meeting we went around the room and each person commented on 
the RFP as interpreted in the memo. . .the meeting finished in a discussion, 
primarily among the senior staff, of the feasibility of accepting the proposal 
or extending the main field-test for another year. . .the decision that 
came out of that meeting was to extend the main f ield-tes t . M 






.1 i.M 

] Ji sc jh -1 ion in the* nee tint; la relev.int to the stated purpose ol 

*. *ie meeting. 

Anyone wit.S something to say that is relevant, is listened to. 
i- Ik iA,c Lsiuns r .‘ached are agreeable to the majority of the staff 
in the meeting. 

1 ASKS : 

NO 

OJ Read KPT to determine its feasibility in cost. 

01 Review coot survey data recently collected in main field test 
of project. 

01 Review aJ i evaluation data received to date in the main field test 
of project to give oral summary in meeting. 

02 Discuss with supervisor what input must oe provided for meeting. 

05 Provide interpretation in meeting of adequacy of cost estimate 

figure in RFP against cost survey data — estimate figure too 
high or too low against what survey indicates potential purchasers 
will pay for product. 

24 Argue feasibility of accepting RFP and advisability of extending 
main field test against field test data available to date. 

24 Write-out comments concerning costs from review of RFP and from 
cost survey data. 

31 Make oral presentation in meeting of evaluation data summarizing 
cost data and other data available. 



ENABLERS: 

s uv 

1 10 Able to quickly interpret data available against specific questions 
raised in meeting. 

1 10 Awareness of who are the primary decision makers in a group and 
their style — authoritarian, nonauthoritarian — in a grave 
situation. 

1 15 Able to summarize field test data quickly and effectively in an 
oral presentation for decision making. 

1 19 Able to anticipate the kinds of data that a certain meeting will 
require beyond what may be specifically requested before hand. 

1 28 Knowledge of leader orientated small group dynamics, especially 
goal directed groups. 



C-56: Conceptual I.euJership for Project 



"You conceptualize what you are doing and you continually go 
and reconcoptual ize it and try and include a number of people in. 
that. There is lots of oral discussion that eventually gets comm 
paper ." 



back 
. .doing 
itted to 



STANDARDS : 

J LM 

2 '33 Staff can expand and extend initial conceptualization greatly 
beyond what is asked of them. 

2 26 Staff generates project papers that evidence understanding of 
concepts of project. 

TASKS: 

NO 

21 Point out to staff areas of project that have not as yet been 
planned out but that are essential to the development and/or 
dissemination of the product(s) of the project, ask that work 
be started. 

23 Obtain for project, recognized experts who supply technical 
consultation, advice, and critique of project. 

24 Maintain commitment to being systematic, following outlines as 
baselines, insisting on concept papers and using outside consultants. 

24 Edit documents written by staff for accuracy and clarity of inter- 
pretations . 

24 Monitor work progress, directions, and ideas formally by regular 
staff meetings and informally by chance meetings or going to their 
offices when time permits. 

25 Encourage staff to use knowledge base available and to be as 
rigorous as possible in their work through frequent interaction 
with the Director or his assistants. 

26 Send senior staff to professional meetings to represent and present 
proj ect . 

26 Critique ideas of senior staff (usually informally) in one to one 
meetings, from experience base in educational R & D, concerning 
feasibility of developing an idea and maintaining alignment with 
general program goals. 

31 Make input to proposal concerning plans and design of proposed project. 

32 Write short document outlining objectives and intended interfaces 
of project product in response to a special request from a govern- 
ment agency. 

33 Challenge staff in meetings, by memo, or chance discussions to 
contribute in some way to conceptual design and planning of project. 



s i:y 

1 <)s Central experience based knowledge of edmwt lonal RDD&K both *r. 
production ,md roanagerrcnt . 

1 2j Know where to look tor help in management of educational K ^ I), 

especially in military and civilian industry with many y r U )u tor- 

perience in R & D. 

2 08 Able to read largo amounts of printed matter quickly. 

2 05 Able to be selective in plotting time to tasks by importance of 

task as reflected by the long-range and daily needs of a project. 
2 49 Able to interact intellectually with all staff either one to one 
or one tc group. 

2 23 Effective in defense of ideas and in persuasion with staff or 
others botfi orally and in writing. 



E-57: Staff Hiring 



"• • .inherited most of the staff I have now. But we do go through 
an elaborate procedure of specifying what the job entails, the qualifications 
we f d like, and salary range.” 



STANDARDS : 

J LM 

2 36 Candidate is intelligent. 

2 36 Depending on the specific job, candidate has a talent for writing. 
2 36 Candidate has some commitment tc the job or general area/field 
relative to the job. 

2 36 Candidate’s credentials reflect indicants of responsibility. 



TASKS: 

NO 

21 Determine whether or not it is necessary to fill a staff vacancy. 
21 Review program plans and production and relate to the current 
balance in the staff. 

21 Develop a job description for the vacancy. 

21 Process the necessary papers relative to announcing a vacancy. 

21 Post the vacancy within the agency. 

21 Interview potential candidates inhouse. 



21 


Interview potent! 


al rand 


Idates 


from outside of 


the 


agency . 


11 


Se ] ec t 


cand idate 


to whom 


a J ob 


offer will 


be made. 




21 


Confer 


with other 


colleagues as 


to their 


opinion about 




hir lng 


a selected 


cand 1 d«' 


ite . 










22 


Detorml 


ne whether 


or not 


there 


is enough 


money 


in 


the budget to 




request 


that a Jo 


b/ staf f 


vacant’ 


y be f i 1 1c 


id. 







ENABLERS: 

S U V 

1 10 Know inhouHC selection and hiring processes and policies. 

2 20 Ability to make decisions. 



P-58: ALERT System 



"The information units were our first generation information system. 

The idea was to package information in selected subject areas. . .As we were 
developing these units we felt that they were too confining in that they 
dealt with only one subject area. We wanted an information system that was 
more comprehensive and global, then users could choose among various subject, 
areas for things they might want to look at. So the second generation 
information system was conceptualized and started, and that is ALERT. It 
will absorb all the work done in information units. M 



STANDARDS : 

J LM 

1 12 System has achieved its objective(s) — based on field-test data/ 
information. 

1 29 All the problems that have been considered in the earlier stages 
have been solved and the system is ready for a mock-up. 

TASKS: 

NO 

01 Read the original conceptualization (paper). 

01 Read (staf f / inhousc) reports of the field test to determine what 
has been learned. 

01 Read the literature relative to dissemination and diffusion of 
information . 

02 Reconceptualize the entire system. 

04 Mock-up the system (or elements of) after conceptualization 
has been somewhat stabilized. 



O r > Conduct preliminary field-test — of the* moik-up. 

03 u.nduct main field-tc-Ht — of the mock-up. 

23 invite ivverai consultants to participate In a a incursion relative 
to the ALERT System. 

Wtiue nofeo tl s the original cum eptn.il ir.i! l< n i tea*:!. 

za Survey : lie attitudes of the staff that work in developing '.he >>:’e 
to deu rmir.o where the proolems are and what might Lc- ar ef r eci iv* 
solnc i on . 

24 Review i particular part of the system by asking /is many questions 
about that part/element as one can think of. 

29 Consult with persons who have been involved with the tield test to 
obtain their reactions. 

29 Discuss ./ith staff to obtain their reactions to various approaches 
that we might utilize in the development and design of the ALERT 
System . 

31 Develop a set of questions upon which the discussion with (outride' 
consultants would be based. 



ENABLERS : 



No information collected under this heading. 



<><) J 



Append 1 >; U; The I'rodm- t -deve 1 opment Strategy 
of tin* Far West Labor.) tor\ for 
Wuc.i t Iona 1 Research and 
Dev el opment 



Tlu* di'vclopmcnf and evaluation procedures of ALFRT basically 
follows l he general d eve 1 opment strategy of the laboratory. That 
general strategy, as it appears in the Con t rac to r 1 s R eques t for 
I97J Fu nd ing , fol lows ; 



The Laboratory product-development strategy has been described 
in a number of publications over a period of time .is a specified 
nuinbei of stages and steps. The number of stages and/or steps 
utilized by various programs in implementing this strategy can 
and does vary. Very generally, the strategy includes ten stages. 

Stage 1, c onceptualization and planning , includes need de- 
finition, a thorough review of the research literature and prac- 
tices that seem to be relevant to the particular needs and 
problems on which the program or component is focused, a detailed 
statement of objectives to be achieved through toe use of the 
product, and preparation of initial specifications of the 
product. It should be emphasized that insofar as possible, the 
product-development work of the laboratory has a firm foundation 
in available education, psychological, and sociological research. 

Stage 2, p reliminary product development , represents all the 
work necessary to create the first form of the product. All the 
ingenuity and creativity of the staff is brought to bear on the 
development of what appears to be the most useful product. Fre- 
quently non-Lahora tory participants and school personnel are con- 
sulted in the development of the preliminary product; certainly 
such development is more than just putting together a number of 
pieces or ideas that others outside the Laboratory have tried out. 
This stage terminates with the decision that the preliminary pro- 
duct is sufficiently well defined and developed to merit testing. 
For some products, this preliminary product development may be 
quite complex, and may include a major portion of the development 
effort; in other instances the preliminary product may be only 
a very rough approximation of a final product. 

In Stage 3, preliminary field testing , the product is tested 
for its feasibility as an idea. The evaluation is most often 
conducted using relatively small numbers of representatives of 
the intended target audience who are acquainted with the problems 
to which the product is directed. The participants in this 
preliminary field test, or feasibility test, are generally given 
the opportunity to respond freely to questions posed by the 
staff, as wo! 1 as to draw attention to problems or questions not 
previously identified by the staff. 
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'.ilinnl ust.* .ir" made. Decisions about tin* ch.ingus t< he made 
ip* !>u h ed on tlu* evaluation judgments and suggest inns made by 
: -«;n J.abura ter y participants and the experiences and observa- 
tions of the stuff in the preliminary i ield testing stage. 
Occasional ly , these revisions may be so extensive that they 
amount to a virtual redesign of the product, necessitating 
a second preliminary field test. 

In S**age 5, main field testing , the product is tested, using 
larger samples of representatives of the intended audience in ac- 
tual working situations. The evaluation Is conducted quite system- 
atically and is designed primarily to provide* information on the 
product's effectiveness in achieving the states objectives. The 
main field test is also used to identify ways in which parts of 
the product might be improved. Generally the staff responsible 
for the development of the product is actively involved in the 
field test as observers of the process and as coordinators of 
the field-testing activities of the participants. An additional 
purpose of this main field test is to identify points at which 
the users of the produces need more, or more specific, directions 
for product*use to insure its effectiveness. Following the main 
field test, decisions are made about possible modifications of 
the product necessary to correct any deficiencies identified 
during the evaluation. If the revisions in the product which 
are made in Stage 6 are quite extensive, the main field test may 
be repeated to determine the effectiveness of the revised product. 

Stage 6, main product revision , usually involves minor 
modification of the product and the development of auxiliary ma- 
terials necessary to insure that the product will be entirely 
self-sufficient when put into operational use. As noted above, 
occasionally the product revisions are so extensive that a second 
main product r.est (Stage 5) lias to be conducted. 

In Stage 7, operational product testing , the materials and 
processes which constitute the product are tested in actual use 
in classroom or school situations without the participation of 
the staff responsible for the product's development; that is, the 
product is tested in the completely realistic setting for which 
it is ultimately intended. The primary purpose of the operational 
test is to determine if the product can he used widely in schools 
without the active intervention or participation of the staff. 

This phase is crucial in the development and definition of a 
proouct, because the Laboratory cannot and does not with to pro- 
vide a service function in connection with its products. Rather, 
the goal of the Laboratory is to produce completed products 
which have been thoroughly tested for use by school personnel 
without ary active participation by the Laboratory staff. 
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^agi product ri'vKjnn, ire I tides the correction 

of the minor < I * * f f o f cue ies discovered in the nprr.i t loin 1 test. It 
may n 1 so include those revisions judged bv t lie potent till product 
1 1 sir f hu l or os essential tor .ulopt Ion by schools, provided they 
^il I not in aiiv wav rediu e the effectiveness of the product. 

Stupe y t d is s cm f nn JLhi n pi u nn i n g , usually requires widely 
varying amounts ol time and effort depending on the nature of 
the product. Kor r : on this starve often is initiated simultan- 
eously with Stupes 5 or 6 and if- ordinarily the Joint respon- 
sibiifty of the appropriate product-development propram staff 
.arid the General Dissemination Program staff. The work generally 
involves identil i cat ion of and negotiation with an outside dis- 
tributor for production and distribution of the final product; 
occasionally it mav involve production of the final product by 
tiie Laboratory. This stage fs terminated after Stage 8, when 
arrangements for elf icient product distribution have been com- 
pi et ed . 



Stage 10, prod uct dissemination , is an open-ended period 
during which the developed products are being distributed on 
a large-scale basis to school users. The General Dissemination 
Program has almost complete responsibility for this phase, with 
the product-development staff involved only in a periodic monitor- 
ing role to insure that the products are still effective in ac- 
complishing their objectives and that they are generally being 
vised in the way for which thev were designed. 



Appendix C: Primary Information Products 

of the ALERT System 



The prototype ALERT System, at the time of observation (June 1971) 
was delivering the following products. 

1 . Sort card j^: An index of several hundred exemplary projects 

and programs developed throughout the country. The cards 
are packaged in . mall "recipe box." Each card represents 
a single program or serves to refer the user to other infor- 
mation sources. Cards are indexed by categories such as 
grade iev«'l, subject area, ability level, and target audience 
Basic information about a program is printed on both sides 
of the card. A brief description or "abstract" is on the 
back of the card. The cards are edge-punched for hand 
sort ing . 

2. Summar ievS : A chart-like, descriptive p .mphlet per program 

that accompanies the cards. These are also packaged in 

a "recipe box." These supply the level of information nec- 
cessarv for initial decisions about the suitability of a 
program for a specific school or need. 

3. Reports ; A detailed description of each major program. 

Not all programs included in the Sort Cards or Summaries 
are treated in Reports. Only those programs that are 
complex and/or highly significant are treated in this 
manner. The Report supplies detailed information on 

goal 3, objectives, content, materials, teaching strategies, 
implementation requirements, cards, and evaluation of 
the program. 

A. Audiovisual Briefings : A Filmstr ip/tape presentation per 

program or programs that require extensive interpretation 
to lay audiences, are so significant that large groups 
would be involved in reviewing them, or are of such a 
nature that a visual presentation is the most appropriate. 

5. Review of Trends : An analysis of major trends and issues 

involved in a select subject area; outline of alternative 
sets of goals, objectives, or criteria involved; descrip- 
tion of selected programs or projects that exemplify the 
trends; and listing of resources, materials, consultants, 
and planning guides that may be used in planning one's own 
program if no suitable program can be located or adapted. 

This ALERT product is developed in subject areas where 
few programs or developments may exist or where the prob- 
lems of selecting a program are complex. 
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use of the reader’s GUIDE to the profiles. 
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Chapter l : Overview 



This chapter contains a narrative introduction to the Paul L. 
Dunbar Community Learning Center Project, including the objectives, 
rationale, and significance of the project and the context in which 
it operates. 



S ynopsis of the Projec t 

Title: Paul L. Dunbar Community Learning Center. 

Responsible Institution: Dallas (Texas) Independent School 

District . 

Funding Source: H. Ross Perot Foundation. 

Funding Duration: July 1969 to June 1972. (36 months) 

Observation Date: April 1971. 

Stage of Development: Mid-Project . 

RDD&E Focus of Project: Educational diffusion. 

Expected Outcomes: 

1. Replicable curricula with the means to adapt to in- 
dividual local situations and the necessary instru- 
mentation to optimize utilization of innovative pro- 
grams. 

2. Packages to facilitate the replication ol curricula 
and the development of staff in their use. 

3. A method of securing parental and community involve- 
ment justifying the designation of the center as 
one of community learning. 

4. Packages to facilitate the replication of similar 
involvement at other centers. 

5. Pupil personnel services appropriate to tha support 
of such a center. 

6. Packages to facilitate the replication of similar 
support services at other centers. 

7. Service to facilitate and develop the replicability 
of each of these other products at other centers. 

Level of Funding and Duration: High-Medium, (level 6 of 7 levels) 

Agency Setting: Large-city public school district. 
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Object Iv es ? Ra t j c na Lo , a ad S ignii i cancc of the Pro j ect 

Objectives . 

1 . To pilot test, evaluate, adapt, and demonstrate a personalized 
total learning system for economically and educationally de- 
prived students that is more cost effective than the existing 
learning system. 

2. To facilitate the total learning commitment by establishing 
and demonstrating a parental and community involvement assoc- 
iated with the demonstration center. 

3. To initiate the ability to diffuse the benefits accruing from 
the system to other schools and learning situations throughout 
the city, state, and nation. Programs reaching installation 
stage in the Dunbar School are communicated to other schools 
within the school district to verify the adequacy of materials 
and service provided in replicating the program. 

4. To establish sources of innovative programs and materials to 
be utilized within the total learning system. 

Rationale . Educational policy-making bodies agree that educational 
reforms should respond in viable ways to the most pressing problems of 
disadvantaged ethnic and socio-economic groups. Recent research and 
experience in developing promising innovations strongly suggest that 
each major segment of the community within which the school rests 
should be appropriately involved in planning and implementing any 
innovational changes . 

Individual research and development institutions tend to focus 
on areas of specialty, and seldom address their efforts to determining 
the most cost-effective approaches. It is believed that a successful 
school system providing a total learning environment must combine the 
best of all these innovative developments, doing so in the most cost- 
effective manner within the context of the school’s operation. 

Further, as repeatedly elicited during the interviewing on the 
project, the precise needs and situations relevant to disadvantaged 
ethnic and socio-economic groups vary from district to district. The 
needs of the people within the Dallas School District are unlikely to 
be identical to those found elsewhere, and, indeed, every locale will 
exhibit different needs which a total learning system must take into 
consideration . 
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Thus, an essential part of the success of this program rests in its 
adaption tv, the precise needs of the local school population. In developing 
the means to make that adaption in this specific learning center, the 
mechanism is at the same time produced that will enable ready adaption to 
occur at each Later environment to which the same material is to be applied 
(i.e., the satellite schools within the same district), some of which may 
address the same ethnic group, some other deprived groups, and finally 
outside this district, as the diffusion method adapts the program progres- 
sively across the whole system. 

Frequently, in t he interviewing, an interviewee would make reference 
to some activity, attitude, reaction of the student, etc., as being a 
feature associated with deprived groups or populations, where upon reflec- 
tion it appeared that the same principles apply with equal validity to 
any student population, deprived or not. Thus, while the groups who may 
have been deprived on the basis of ethnic discrimination may be the first 
to benefit from the advantages accruing from this program, it has implica- 
tions that can benefit education in all contexts, many of which would not 
generally be viewed as deprived. 

Significance . Basically, this project represents a large-scale, 
inhouse diffusion effort for innovative educational developments, and 
the adaption of these innovations to the characteristics of the district 
serves as a major vehicle for the effort. In determining the effort’s 
significance, it would be a mistake to quote only statistical figures 
as evidence that something worthwhile is happening at the Dunbar Center. 

Such figures do indicate success for this project, but another more 
immediate and convincing indicator results from a visit to the center. 

In visiting the center, one is more likely to feel and to witness the 
enthusiasm existing as a significant aspect of this project’s success 
than if only the statistical figures representing the data were 
observed. 

Important also to this project’s success is the role change 
for the school as observed by the community it is serving. Where the 
traditional school was felt to have made little educational difference to 
the community, the ’’learning center" is seen as more accessible and 
more mindful of the needs of the people, as observed by the community 
in which it is located. 



Context in Which the Project Operates 

Relationship to the parent agency . The parent agency is the city- 
wide school district. The district office negotiates all funds for 
the school, both for the functioning of the school and for the operation 
of this specific project. Thus, the Project Director within the parent 
agency is fiscally responsible for the project’s continued funding, 
but it is the Principal of the school who is the functional Director 
of the project in the school setting. He is responsible for what 
happens within the school. 
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It is Import ;int to n^ti* that this is an operational setting, 
l( Is dynamic and ongoing, not lost fTmdnl as a mio-l line ellort to 
he l oin lutled with a I Inal report. 

Re lat l(3n sh ip i r> the 1 inul Ing sponsor. The funding agency , the 
II. Ross Perot f( mula t i op , closely mon 1 1 e iv. reports from the project* 

The contractual details ate flexible enough that ii a demonstrably 
cost-ef f ert ive addition to a program within the project is put forward, 
the funds are usually quickly forthcoming. 

Relationship to .innov a tive prog ram s o u r c e s ( publishers and labs) . 
The project has worked out agreements with providers of source materials 
to furnish them with feedback from t he project on a cost-shared basis. 
This includes an agreement for profit-sharing if any proceeds from 
the project accrue as it is diffused into other districts. 

Relationship to initial diffusion locations (satellite schools) . 
Nine schools are presently designated as "satellite" schools for 
further trials and adaptation of specific programs being installed at 
the Dunbar Center. These are presently within the same parent agency’s 
jurisdiction, and thus are part of the same general program. However 
the Dunbar Center provides these satellite schools with materials and 
advisory services, as will be described in the reporting of this 
project . 

These contextual relationships are depicted in Figure 1. 

Supporting and technological service s. Various consultants 
in statistical methods, research design, and subject matter areas, 
are made available through the parent agency along with data-processing 
facilities. Materials connected with innovative programs are 
made available on a cost- and profit-sharing basis with cooperating 
laboratories and publishers. 

Physical /environmental setting . There is, as might be expected, a 
contrast between the modern, air-conditioned suites of offices occupied 
by the agency, and the school setting in which the work of the project 
takes place. The latter, however, is seen by those involved as a 
tremendous improvement over what the same facility previously had been. 

In the way the school facilities were used, they seemed quite 
adequate. Students were not operating in overcrowded conditions. 

The building, though old, was well maintained and had been renovated 
in many places to provide better facilities than it formerly offered. 

The only criticism heard about the facilities was that they lacked 
air conditioning, which certainly would be conducive to comfort in 
that climate. It was observed that, while some members of the staff 
visibly perspired at their work, they maintained a high degree of 
enthusiasm for what they were doing, which suggested that the lack 
of air conditioning did not seriously detract from their efforts. 
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FIG. 1. Contextual map. The number of ^satellite 
schools varies at any one time, subject to 
activity in the proceeding of the overall 
program. 
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Chapter II: Parameters of the Project 



This chapter discusses the functional structure of the Dunbar 
Project and describes the outputs being generated. 



Project Structure 

Figure 1 is a contextual map that illustrates project-context rela- 
tionships. The core of the project is the Dunbar Learning Center 
located at the Dunbar School. Supervision and direction come from 
the school district office. The center works primarily with innovative 
programs obtained from outside sources, which it modifies and/or 
adapts to the specific needs of the population served by the district, 
and in particular the students within the Dunbar Center. After a 
first round of development, these same programs are then extended into 
general classroom use within the Dunbar Center and later out into 
satellite schools within the same school district. 

Figure 2 is an organisation chart of the Department of Research 
and Development within the school district, indicating the services 
within this category that are made available to all schools in the 
district as required. 

Figure 3 is the functional organization chart for the Dunbar 
Learning Center, divided into two major headings: learning functions, 

and research and development functions. 

Figure 4 illustrates a partial detailing of programs on which 
the center is working. This is broken down to indicate the age or 
grade level range through which each is operative. 

Figure 5 is a similar, partial time line chart ‘indicating 
the progressive installation program planned for this and future years. 

Figure 6 is a model for the evaluation system flow chart 
forming the basis for the development and evaluation employed in this 
project . 

Figure 7 represents a more detailed organization chart for 
Learning Center, from which the organizational structure within 
center is clearly seen. 
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FIG. 3. Organizational structure for the Dunbar Learning Center. 
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FIG. 5., Detailed products development schedule. 
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Outputs Generated 

Index of outputs . The outputs which were identified are briefly 
described here. Outputs are defined as identifiable and significant 
planned outcomes (product, event, condition) of targeted work activities, 
with targeted work activities being actions directed toward the realiza- 
tion of projected goal states. An arbitrary identification number has 
been assigned to each output consisting of a numeral and a letter. The 
letters P, E, and C represent product, event, and condition which are 
defined as follows: 



Product: A tangible or "hard 11 outcome of work effort that 

survives in a form that is transportable, such as 
a report . 

Event: An outcome of work effort that results in the 

occurrence of an observable transaction, such 
as an interview. 



Condition: An outcome of work effort that results in the 

creation of a desired circumstance, such as 
fiscal responsibility . 



In this project, conditions are seen as the keystone elements and 
are identified first, followed by events and then by products. An 
asterisk (*) preceding the output identification number indicates that 
the output was interviewed around. 



Conditions . The following conditions were identified as outputs of 
this project. Each of them has the same maj focus as the whole project- 
diffusion — and each of them is an ongoing, or a developing condition. 



*C-53. Parental Involvement Program. This is an ongoing program 
designed to involve the community in gaining parental 
support and cooperacion. It provides service of direct 
benefit to the community and allows parents to directly 
affect what happens to their children in the school 
setting . 

C-54. Coordinated Curriculum .. The changes in philosophy 

of education on which the innovative programs incor- 
porated into this project depend, necessitate a co- 
ordination that enables all elements to work together 
toward a common goal: a better overall learning 

program for children. 



*C-55. Pupil Personnel Services . As the center organizational 
chart (Figure 7) shows, this department consists of a 
counselor, a nurse, and two visiting teachers. This 
staff sees their role as coordinating and serving 
students and personnel. 



*C-57. Staff Acceptance of Change . The other conditions are 

those visible from the outside. In order to successfully 
implement the changes desired in this project, the staff 
must accept and work with the desired changes . While the 
other conditions are major efforts to which personnel are 
assigned, this is a j^ouc^tion seen by the management as 

tA r ''c 
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one to be provided for the staff, rather than having a 
staff to provide it. 

Events , Directly serving C-54, Curriculum Coordination, are a series 
of ongoing events, each related to the specific program or working center 
with which it is connected. This connection can best be seen as an on- 
going revision of the basic program that formed the input, or starting 
point for that working center, and which results in a revised program 
adapted to the needs of the population served. 



Reference is made to these "working centers" throughout this pro- 
file. Each program became the subject of a working center, within the 
Dunbar Learning Center. Thus E-Ql is a working center in communication 
skills, and results in a revised communication skill package, P-13. 
Coupled with Output P-14, E-02 relates to a working center in multi- 
cultural social education, and so on. Therefore, there is a difference 
between the terms "working center" and "Learning Center" as used in 
this project and related through this profile. The Learning Center is 
the entire operation at the Dunbar School, while the working centers 
are the groupings of basic programs within the Learning Center. 



The Outputs, P-13 through P-24, like the events that produce them 
and keep updating them, are ongoing, but in themselves constitute the 
output of development. 



*E-01 . 



*E-02, 



E-03 , 



E-04 . 



E-03. 



E-Ob . 



Revision of Student Learning Program in Communication Skill (SWRL) . 
This is an innovative program of the Southwest Regional 
Educational Laboratory being adapted for use in this 
project , 

Revision of Student Learning Program in Multicultural 
Social Education (SRDL) . This is an innovative program 
being modified for the working center’s needs. 

Revision of Student Learning Program in use of Hilda Taba 
Strategies . Another specific innovation, although Taba 
strategies are used in this project far more widely than 
these specific revisions. This item was not specifically 
interviewed around, although much information on adaptation 
of Taba strategies was obtained elsewhere. 

Revision of Student Learning Program in AAAS Science (NSF) . 

This is a revision of the American Association for the 
Advancement of Science’s program in science. 

Revision of Student Learning Program in IPI Mathematics (RBS) . 

This is a revision of the Individually Prescribed Instruction 
mathematics series. It was not interviewed around specifically, 
although the class was observed. 

Revision^ of Student Learning Program in Suzuki Music . This is 
a revision of the Suzuki violin music program. Although not 
interviewed around specifically, some information was received' 
by observing the class. 
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Revision of Student Learning Program lu Or f 1 -Kodall y Music . 
Lot specifically interviewed around, this is a revision 
of the Orff-Kodally program in music. 

E-08. Revision of Student Learning Programs in Early Childhood 

Education (SEDL) ■ Not specifically interviewed around, 
although some comparative information was gleaned in 
interviewing around E-09. 

E-09. Revision of Student Learning Program .in David Weikent 

Early Childhood Education . The project is developing 
strategies of its own for early childhood learning called 
"Gateways," but as yet this is not identified as a separate 
program. These strategies borrow in their concepts from 
David Weikert and others, so the interview around early 
childhood learning is included under this. 

E-10. Revision of Student Learning Programs in Distar (Bereiter- 

Engleman} . Not specifically interviewed around, this is 
a revision of the Distar Program. 

E-ll. Revision of Student Learning Programs in Visual Art . 

Not specifically interviewed around, although the class 
was observed. 

E-12. Revision of Student Learning Programs in Physical Education . 

Not interviewed around, although the class was observed. 



Products . Deriving from the processes that occupy this project, and 
continually being modified by these processes, are the various products that 
are replicated for the purpose of assisting in diffusion, first to satellite 
schools and later further afield. Note that P-13 through P-24 are titled 
"staff development packages" in their respective programs. The emphasis is 
on enabling staff to replicate the process developed during E-01 through 
E-12 at the Learning Center in adapting the programs to every setting to 
which they are applied. 

P-13. Staff Development Package for Student Learning Program in 

Communication Skills. In P-13 through P-24, emphasis is 
on the process that the package will facilitate, even though 
the package as a product is intended to enable the program's 
replication. 

*P-14. Staff Development Package for Student Learning Program in 

SEDL . This item was interviewed around in depth, and a 
student class was observed. 



P-15 Staff Development Packages to Facilitate Installation of the 

through Programs covered in E-03 through E-12 respectively. None 
P-24. of these was specifically interviewed around. 
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The following products are listed as entities for the sake of 
grouping. Most of them constitute packages of products to fulfill the 
purpose named, and thus serve an implied "event" not specified by name 
(as in E-01 through E-12). These products have all been identified 
and are at least in progress. Some are at a stage of usable completion, 
but still subject to potential refinement as the project continues. 

P-2 5 . Pupil Personnel Packages in Individualized Instruction . 

See comments under P-34. 

P-25. P upil Personnel Packages in Tutoring . In this project, 

"tutoring" is a provision for older students to tutor 
younger students needing some assistance on a one-to-one 
basis. This process was observed, although not specif- 
ically interviewed around. 

P-27. Pupil Personnel Packages in Parent Counseling . See comments 

under P-34. 

P-28. Pupil Personnel Packages in Health Education . Not specif- 

ically interviewed around, although information concerning 
a specific example was obtained in the interview around 
C-55 . 

P-29. Pupil Personnel Packages in Taking Tests . See comments 

under P-34. 

P-30. Pupil Personnel Packages in Interpreting Tests . See com- 

ments under P-34. 

P-31. Pupil Personnel Packages in Self-development . See comments 

under P-34. 

P-32. Pupil Personnel Packages in Careers . See comments 

under P-34. 

P-33. Pupil Personnel Packages in Problem Solving . See comments 

under P-34. 

P-34. Pupil Personnel Packages in Study_ Centers . Around P-24 

through P-34, which constitute a very comprehensive 
set of packages to aid in implementing and replicating 
successful pupil personnel services, information of a 
general nature was obtained while interviewing for C-55. 

P-35. School Paper . Now discontinued, this was a periodic news- 

paper prepared by the parental involvement group and dis- 
tributed in the neighboring area of the Learning Center. 

P-36 . Parents * Participation Handbook for Staff . A handbook designed to 

help parents know how to participate in the Learning 
Center. 



O 
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P- i 7 . Early Childhood Handbook for Parents . A handbook de- 

signed to aid parents in fulfilling early childhood 
educational needs with their children at home. 

P-38. Parental Involvement Brochure . A brochure setting 

forth proven methods of securing parental involvement. 

This brochure is designed for use by school systems. 

P-35 through P-38 were not specif ieally interviewed around. How- 
ever, information about them was gained in the interviewing around C-53. 

P-39. Final Project Report . The completed project will be 

documented and presented to the appropriate official in 
the sponsor’s agency. 

P-40. Project Progress Reports . These are reports to the school 

district and the funding agency about the details of 
programs within the project. 

*P-41. Qu arterly Budget Summaries . A projection of necessary 

expenditure for the ensuing quarter, to accomplish project 
plans during that period. 

P-42. Mon t hly Budget . A projection over shorter time base, and 
less formal than P-41, to facilitate operation. 

Items P-43 through P-50 represent generic sets of evaluations, each 
of which is used across the relevant events and products to which it 
refers. To attempt to describe each, beyond this simple relationship, 
would have entailed more time on the project than our interviewers had 
available. P-43 was interviewed around, as exemplary of the whole set 
of generic products. 



*P-43. Process Evaluation Reports for Revised Student Learning 



P-44 . 


Program. An across-the-board 
the programs in process. 

Process Evaluation Reports for 


report collected from all 
■ Staff Development Packages. 


P-45. 


Process 


Evaluation 


Report 


for 


Pupil Personnel Packages . 


P-46. 


Process 


Evaluation 


Report 


for 


Parental Involvement Packages 


P-47. 


Product 


Evaluation 


Report 


for 


Revised Student Learning 




Program, 










P-48. 


Product 


Evaluation 


Report 


for 


Staff Development Packages. 


P-49. 


Product 


Evaluation 


Report 


for 


Student Personnel Packages. 


P-50. 


Product 


Evaluation 


Report 


for 


Parental Involvement Packages 



A 




P-51. 



Evaluation Designs for Products for Student Learning 
Program . Particularly for the results of revisions 
represented in E-01 through E-12. 

P-52. Curriculum Development Process Handbooks . These handbooks 

were designed for spelling out the curriculum developments 
intended to meet identified needs. 

*P-56. Product Evaluation Reports . A generic form of evaluation 

used as a basis for reports on P-47 through P-50. 

Output map . The outputs of the Dunbar Project described above are 
presented graphically in Figure 8 showing the dependent relationships 
between them. 



O 
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FIG. 8. Output map. 
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Chapter III: Summary of the Data 



Interview data were gathered around the selected outputs described 
in Chapter IT. The interviews sought to elicit for each output to be 
analyzed (a) the standards by which one judges the satisfactory completion 
of the output, (b) the tasks required to generate an output meeting those 
standards, and (c) the e nablers (knowledges, skills, and sensitivities) 
which facilitate the carrying out of those tasks. The tables included 
in this chapter summarize the interview data by these categories (stand- 
ard, task, knowledge, skill, or sensitivity'' and ny the outputs inter- 
viewed around. 

Within each of the categories are a series or set of descriptive 
labels which are representative of interviewee statements (raw data) 
within a particular category. These descriptive labels are listed in 
the table under the category heading. In the process of reducing raw 
data (interviewee statements) about an output, these narrative statements 
made by the interviewee were linked to one of the categories of standards, 
tasks, or enablers. Each narrative statement was then classified by 
means of a number code according to the most representative descriptive 
label within a given category. 

During data collection open-ended questions about each of the 
categories were asked of the interviewee with respect to a particular 
output of the project for which he carried major responsibility. In 
most cases each output was interviewed around with only one project 
staff member. However, when time permitted, a major output was inves- 
tigated through interviews with more than one staff member. Care was 
taken to select, whenever possible, an informant for each output who 
had both consistent and major involvement with the output’s production. 

However, on this project the actual number of individual outputs 
that personnel produced reaches a very considerable size. They are fre- 
quently completing or preparing instruments, for example, or assessing 
and interpreting the results of those measurements. The important things 
on this project are not how all these many small things are done so much 
as how all this work fits together so that the desirable ends result. 

For this reason the products, events, and conditions interviewed around 
are those at much more ' comprehensive levels. In the course of such inter- 
viewing, mention is inevitably made of many of the more detailed outputs, 
but not at the detail level — their use is taken "as read. 11 

Each of the tables to follow in this chapter provides the frequency 
with which these interviewees cited specific category statements around 
the outputs identified. These specific statements are represented by 
the descriptive labels in the tables, which by means of the table are 
linked within a category to a specific output. Descriptive statements 
for standards are found in Tables 1 and 2, those for tasks in Table 3, 
knowledges in Table 4, skills in Table 5, and sensitivities in Table 6. 1 



^Tf the reader is Interested In the narrative statements of the 
Interviewees (raw data), these can be found in the Appendix. To locate 
(footnote continued on next page) 
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A diffusion effort of t he kind and magnitude required of this pro- 
ject, in concentrating on the human factors felt hy the staff to he vital 
to their efforts, found the interview team looking at the central foe I 
of efforts or processes by which the desired ends ol the project were 
being achieved and by which the various people involved were being brought 
together to produce those ends. 

The three central features of the ongoing project are Parental 
Involvement (053) , Curriculum Coordination (C-54), and Pupil Person- 
nel Services (C-55). In questioning about these conditions, information 
falls out about many products and events either serving to achieve 
them or to replicate them. This may be, for example, only at the 
level of a task description that says "design an evaluation form," 
thus revealing that such an evaluation form is a product of the overall 
ef f ort . 

The main questioning, therefore, was directed at what brought about 
C-53, C-54, and C-55. Some of this questioning was at a more specific 
level, however, such as that applied to a curriculum subject or to the 
early childhood level. The tables in this chapter summarize the inter- 
view data and enable it to be critically examined. 

Table 1 lists categories of standards indentified as production 
oriented. Note that C-53, Parental Involvement, lists only one standard 
in this table, "Functions as planned." 

C-54 aid C-55 on the other hand, have more production-oriented stand- 
ards mentioned. The group of standards listings under C-54 in Appendix 
A indicate some objectivity in measures used in developing a coordinated 
curriculum. The group of listings under C-55 in Appendix A indicates 
the standards recognized for pupil-personnel services. Note particularly 
the four different evidences of utility of value listed with the J-LM 
identifier 1 05: 

"provides for needs, rather than solving problems," 

"relieves anxiety by parent specific behavior to turn to, 
in order to help work on his problem," 

"it teaches an approach to raising children, to relating to 
children, that can be measured by control," 

"achieving greater exactness in choice of multidiscipline 
approaches ." 



the narrative statement for any given category, standard, task, or 
enabler, first note the output and its identification number in the table. 
Second, note that each descriptive label within a given category has a 
distinct number or code. Turn to the Appendix and locate the output. Under 
the output locate the category label or heading (standard, task, or enabler) 
and pinpoint the number or numbers (depending on frequency cited) of the 
descriptive label v;hich appeared in the table. The statement opposite 
this number in the Appendix is the original narrative statement from an 
interviewee and is only represented in the table by the descriptive label 
and its number coding. 
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E-01 


Revisions of Student learning 
Program in Communication 
Skills 


1 
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4 














4 


E-02 


Revisions of Student learning 
Program in Multicultural 
Social Education 


1 

1 




1 
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1 
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revisions of Student Learning 
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Childhood 
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1 
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P-41 


Quat ter ly 
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1 
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P-43 


Process Evaluation 
Report for Rev ' ^ed 
Student Learning Program 


1 




1 


1 


1 






1 
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Parental 
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Table 2 picks up a different class of standards, those identified 
as be i.ng of a management type. Again, noting, particularly the entries 
for C-53, C-54, and C-55, "Parental. Involvement" picks up in this table, 
while the others have fewer entries. Note the variety of evidence 
expressed againsc the J-LM identif lets 2 17 fc r C-53 in Appendix A: 

"more than 500 parents a month go through the homemaking program," 
"25% of enro .lees in black studies courses are white," 

"support (attendance) from wide geographical area on many 
programs , " 

"they have surpassed expectations in more programs than they 
would have planned — effort of self-motivation." 

For C-54 and 055 there are only one and two management standards 
listed respectively. These seemingly reflect reactions that are 
evidence of success. 

Table 3 lists the frequency with which categories of tasks were 
mentioned in connection with various products, events, and conditions. 
This is a more "dense" table than the others. Some 18 different major 
categories of tasks are listed, with total frequency counts varying 
from 1 to 49. Note that the highest number (49 times) refers to 
"producing the product." 

Table 4 lists knowledges mentioned as being necessary for various 
tasks connected with products, events, and conditions. One knowledge 
apiece is entered against three of the conditions questioned around. 

The knowledges center primarily around products, with some mentioned 
around events. 

Table 5 and 6 list, respectively, skills and sensitivities mentioned 
in connection with various products, events, and conditions. Note that 
staff acceptance of change ( C— 5 7) lists four sensitivities as enablers, 
each appearing in Appendix A as sensitivity to: 

"the black problem in a southern city," 

"white prejudice in black capacity," 

"childrens need for firm but gentle discipline," 

"teachers* need for definitions and limitations of responsibility.*' 



1 
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TABLE 2 

Process Standards Cited for f.nch Output Analyzed 



Output 


Management Standards (set J-2) 


04 Meeting of deadlines 

1 

07 Recurrence of activity 

1? No gaps in representation of sk. 

14 Feeling no deficiencies 

15 Tasks perceived A action taken 

17 Public inflect interest in out- 
| come 

24 Cost/beneflt relationships 
acceptab le 

33 Adequate growth evidenced 

34 Effort shows favorable reaction 

I 39 Evidence of preplanning 


— 

Totals 


E-01 Revision# of Student 
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Learning Program in 






Communication Skills 


1 1 1 


3 


E-02 Revisions of Student Learn- 






ing Program in Multi- 
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2 


2 


E-07 Revisions of Student 
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2 


2 


P-14 Staff Development 






Package in Social 






, Studies Program 


1 1 1 


3 


P-41 Quarterly Budget 


1 1 


2 


P-43 Process Evaluation Report 
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1 


1 
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C-55 Pupil Personnel Services j 


2 


2 


C-57 Staff Acceptance of 






Chang . 


1 12 


4 


Totals 


1 2 1 1 2 5 3 1 8 1 


25 



3v7 



If )2H 



1 AbLK J 



Tasks Cited for Inch Output Analyzed 



Production Tasks (set NO) 



& QJ -* 



tc d 
c o 



Outputs 



tS CN fM M (N 



Totals 
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ing Program In Multi-cul- 
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E-07 Revisions of Student 
Learning Program In 
Music 

E-09 Revisions of Student 
Learning Program 
in Early 
Chi ldhood 

P-14 Staff Development 
Package in Social 
Studies Program 

P-41 Quarterly Budget 

P-43 Process Evaluation Report 
for Revised Student 
Learning Program 

C-53 Parental 

Involvement 

C-54 Curriculum Coordination 

C-55 Pupil Personnel Services 



P-56 Product 

Evaluations 

C-57 Staff Acceptance of 
Change 



4 11 



14 



18 1 

4 8 1 
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12 
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1 



2 3 1 17 

5 3 2 2 
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16 

16 
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TABLE 4 

Knnbling Knowledges Cited for Each Output Analyzed 



l 



o 
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Knowledg.es C ate gories (s et S-l) 



Outputs 

E-Ol Revisions of Student 
Learning Program in 
Communication Skills 

E-02 Revisions of Student Learn 
Ing Program in Multi-cul- 
tural Social Education 

E-G7 Revisions of Student 

Learning Program in Music 

P-14 Staff Development 
Package in Social 
Studies Program 

P-41 Quarterly Budget 

P-43 Process Evaluation Reports 
for Revised Student 
Learning Program 

C-54 Curriculum Coordination 

C-55 Pupil Personnel Services 

P-56 Product Evaluations 

C-57 Staff Acceptance of 
Change 



Totals 
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TABLE 5 

Enabling Skills Cited for Each Output Analyzed 



i 
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E-01 Revisiona of Student 
Learning Program in 
Communication Skills 

Revisions of Student Learn- 
ing Program in Multi-cul- 
tural Social Education 

E-07 Revisions of Student 
Learning Program in 
Muaic 

E-09 Revisions of Student 
Learning Program 
in Early 
Childhood 

P-14 Staff Development 
Package in Social 
Studies Program 

P-41 Quarterly Budget 

P-43 Process Evaluation Reports 
for Revised Student 
Learning Program 

C-53 Parental 

Involvement 

C-54 Curriculum Coordination 

C-55 Pupil Personnel Services 

P-56 Product 

Evaluations 



Totals 



Totals 
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TABLE 6 



Enabling Senai t tvi t ie b Cited for Each Output Analyzed 



Sensitivities Categories (set S-3) 
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E-02 Revisions of Student 
Learning Program In 
Communication Skills 
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1 
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Chapter IV: Supplementary Data 



This chapter contains information about the backgrounds of project staff, 
the resources indicated by them as available for carrying out project tasks, 
and the classification of outputs. 



Summary of Staff Background 

Of the 36 professional staff members directly assigned to the project 
at the time of the visit, one has a doctorate, 25 have master’s degrees, 
and 10 have bachelor's degrees. The members of the clerical support 
staff have no academic degrees, and all work at the Learning Center. 

Of the 13 people formally interviewed in connection with this pro- 
ject, 10 were located at the center and three at the district office. 

Of these, nine completed questionnaires, in addition to the formal inter- 
view, and from their responses the following information is drawn. 
Questionnaires were received from two people at the district office 
and seven at the Learning Center. 



In answer to the question about what in their professional training 
was most relevant to their tasks, some responded with a list of courses, 
while others questioned whether any of their formal training was relevant 
(although maybe not in those words) . There were some answers such as either 
a workshop, a personal training session, a specific work experience, or 
combinations of such that pinpointed a specific time frame that gave these 
individuals their own "spark" allowing them to contribute in their own 
unique ways to this project. 

Of the nine who responded, eight^ had an aggregate of 39 years working 
in public schools. Most of them had prior experience working on R & D 
projects and several of them had been principal investigators for projects. 

One thinks of such a project as functioning in its own context and 
that possibly the Project Director, and maybe one or two of hid assistants, 
may get out to '’spread the gospel” about what the project is doing. A 
surprising part of the response in these questionnaires is that most of 
these people get out to make presentations about their work. 

The specialty of highest degree centered in educational administration, 
with some in teaching, educational research, guidance/counseling, statistics 
and measurement, business administration, and some subject-matter spe- 
cialties, such as music, mathematics, child development, and curriculum 
supervision. 



In answer to questions about specific knowledges and skills that the 
position requires, various specialties were again named, with emphasis on 
statistics, accounting, measurement theory and test construction, and 
philosophy of learning and educational psychology. However, one skill 
recurred in the responses, though individuals used different words to 
describe it: "strong leadership of the democratic variety.” 



‘The ninth did not respond in this category. 
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Support KcHourrcH 

ServJcej*. (2 ho c:kc* (I on Lhe questionnaires by various personnel as services 
provided and necessary to the carrying out of their jobs were: 

Equipment, construction (mechanical, electronic, carpentry, etc.). 

Print ing . 

Photography. 

Art work and illustrations. 

Technical writing. 

Editing . 

Secretarial service, other than typing. 

Typing. 

Purchase of supplies and equipment. 

Library holdings. 

Subscriptions co technical and professional joumals/periodicals . 

Requests for documents or publications not locally available. 

Computer analysis services, (data processing) 

Computer program writing. 

Statistical consultation. 

Audio-visual aids and devices. 

Subjects for experimentation or try-out of procedures. 

Travel arrangements. 

Budgetary and other fiscal financing. 

Scoring of test items. 

Television facilities and equipment. 

Support Equipment . Checked by various • personnel as immediately available 
and used by them in the project were: 

Dictating equipment . 

Desk calculators. 

Remote computer terminal. 

Onsite computer. 

Key-punch machine. 

Data card sorter. 

Photographic equipment. 

Video tape . 

Television camera. 

Readers for microfiche or microfilm. 



Classifications of Output Characteristics 

Outputs may be categorized in terms of a number of variables. Among 
them are (a) Structure (product, event, or condition), (b) Function (policy 
setting, management, or production), (c) Level (focal, component, or 
facilitating), (d) Character (knowledge, technology, implementation, or 
information), and (e) Stage of completion. These five schema are repre- 
sented in Table 7 for each project output identified, with frequencies 
summarized for each category. 
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The specific output characteristics are Identified es follova: 



Structure 


Function 


Level 


Character 


Completion Stage 


p - product 
e - event 
c - condition 

k 


pa - policy aettlng 
■ - management 
p - production 


fj - focal 
c - coaiponent 
f 2 - facilitating 


k - knowledge 
t - technology 
1} - Implementation 
lj “ information 


1 - completed over one year ago 

2 - completed 3 to 12 montha ago 

3 - completed within last 3 moa. 

4 - currently In progress 

5 - not yet underway 

6 - on going (continuous) 



k Data totals In this table may vary slightly from data in tablea reported elsewhere. This Is a function of decision rules 
governing classification of outputs having been revised and applied to theac data aubaequent to the preparation of the 
profile. 
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Chapter V: Dynamics of the Project 



Focus of the Projec t 

A reaction of many visitors to the Dunbar Learning Center is a feeling 
that M successful" learning is occurring. Documentation indicating such 
success is found in the results of the many measures conducted and the 
analyses run, but these are not the only evidence demonstrating the 
success of the project. 

Kveryone associated with the project demonstrates a commitment 
to its success and to cost-effectiveness. The data are analyzed to determine 
which of a variety of available programs most cost-effectively produces 
certain learning outcomes. The data are also used to measure the merit of 
changes, attempts at improvement, and where weak spots have been observed 
in specific programs. All of this activity may be unprecedented in such 
a setting, but the results apparently justify the cost in the eyes of 
the district. They feel the variety of programs being installed and dif- 
fused throughout the district are achieving their intended goals. 

There is more to identifying this acceptance than the collecting and 
analyzing of empirical data and then applying their interpretations to 
optimize the results of the activities occurring in the Learning Center. 

These data can reflect the learning that occurs, but much of what occurs 
happens because of human relationships that promote the desired results 
in nonverbal ways. These kinds of nonverbal behaviors are not subject 
in this setting to being empirically analyzed. 

At the district office a main concern is with measurable results, 
mainly because that is where such results are accumulated and attended to. 

At the Dunbar Center, the concern is also with measurable results in 
terms of cost-effectiveness, but a further concern is with how those 
results are achieved. Because the human interactions occur at the Learning 
Center, the straff are primarily concerned with doing the "right things" to 
bring about the desired results. 



How the System Works 

Each of the various subject area programs handled by the overall 
program is implemented or worked on by a working center within the 
Dunbar Center. Such a working center consists of an assigned group of 
staff, including a center teacher, a curriculum writer, and sometimes 
a paraprof essional aide. These two or three staff members work with 
a group of about six children at a time, using the materials they are 
developing within that subject area program. Children from regular 
classes are selected in succession for periods of activity in the 
working centers. 

The objective of this working center group is to develop materials 
that will enable the procedure and its accompanying learning process 
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Lo be l rails f* erred , first to the regular classroom teachers in the Dunbar 
School, and later to their counterparts in satellite schools. To aid 
in this, site coordinators provide the necessary linkage that enables 
feedback to occur in filling in details that may be missing from the 
packaged materials as used at Dunbar. 

Earlier in the projects life the roles of center teacher and cur- 
riculum writer were separately specified, but in the present operation 
the staff in each center are encouraged to exchange roles so that each 
gets the "feel" of the whole activity. 

The curriculum consists of a form of lesson outline specifying 
strategies for conveying subject content rather than the actual subject 
content to be conveyed. This design is intended to bring about the 
desired learning outcome or objective. Working with the outline in its 
current form, the person momentarily acting as "teacher" works with 
the children in the working center group, while the other person acts 
as an observer, and uses a checklist type of data-collect ing instrument 
to detail the fulfillment of prescribed strategies and the actual * 

responses of students while the lesson is being conducted. 

The staff development person assigned to a specific working center 
works with both the center staff already referred to and with regular 
teachers. In conjunction with the site coordinator, staff development 
personnel also work in conjunction with teachers at satellite schools 
who are participating in specific programs being diffused to those schools. 
(Not all of the satellite schools take all the working center programs 
being worked on in the Dunbar Center.) The objective of these efforts is 
to develop staff development packages associated with each program that 
will adequately prepare the staff to engage in the activity of the pro- 
gram. 



While the setting in which the central activity around which inter- 
views were conducted was a learning center for a black community, the 
district is fortunate in having a variety of populations within its 
jurisdiction. Thus the satellite schools-, which the interviewer time 
commitment unfortunately did not allow to be covered, are located where they 
serve other groups, such that further adaption is needed, using the same 
techniques developed at this center, but for a different target popula- 
tion . 



In this project, a different approach to integration has been 
adopted. As well as being less costly than bussing numbers of students 
to more distant schools, it appears to have advantages to the student 
population served. This is to "integrate" — that word was not used — the 
faculty. White personnel have been introduced into a school where the 
faculty had formerly been all black. Most of the individual working 
center teams consist of some black and some white individuals, who work 
together and periodically exchange roles, as described elsewhere. Thus 
the children observe, in a nonhostile environment, persons of both races 
working together. 

Most of the programs used in the working centers for adaptation to 
the school’s population needs originated elsewhere; for example, from 
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educational laboratories or commercial publishers. In some instances, 
a department consisting of several centers working on different programs 
in the same subject area will work on putting together the better features 
of such programs into a single unit developed in the Dunbar Center, and 
then work to optimize that material. 

Staff preparation is extremely important because the emphasis is 
on strategy that is quite teacher dependent. The Hilda Taba strategies 
are used extensively and have been an influence on other methods used. 

The teacher, in this strategy, does very little "telling 11 or instructing 
in the conventional sense. Student thought in the desired direction is 
initiated by questioning. For example, in a social studies class an 

initial question might be, "if you were and lived in then 

what do you think Y ou might be doing?" Such an initial question is open 
ended, in that no specific set of answers is expected. Students new to 
such strategies may need further questions to encourage them to answer, 
but those students observed by the interview team while oivMte needed 
little such encouragement — they were eager to answer. 

The teacher works to obtain participation of all students, and this 

is found to be simpler to achieve with open-ended questions. It avoids 

the need for students to repeat answers they have already heard from 
other students, or to find a different way of saying substantially the 
same thing, although this is accepted. 

Answers felt to be inappropriate are not simply rejected, but pursued 
by further questioning as a means of leading to what is felt to be more 
acceptable answers. For example, if a student suggests that an inhabitant 
of a hot desert area lives in an igloo, questions leading to a 

reason why this is inappropriate are used. (That rather extreme example 

was not heard at any of the centers.) 

At the early childhood (preschool) level, the David Weikert strategies 
are highly favored because of their results. These strategies distinguish 
four levels of representation for concepts and four goal areas within which 
concepts to be learned may be categorized. 

The four levels of representation are: 

1. Object Level . Th^s is the lowest, in which only real 
objects are identified, directly and visually. 

2. Index Level . At this level, senses other than sight 
may be used. For example, the smell of an orange may 
be identified by the name of the fruit. Also, sight 
may be used in an indirect way. For example, spoors 
may be used as evidence that the animal they identify 
passed that way. 

3. Symbol Level . At this level, either two-dimensional 
pictures that convey the impression of the person 

or object may be used as representation, or the level 
may also include students role playing the persons 
or objects named. 
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A. Sij»n Level. Here the student reeogn 1 zed the printed 
word that represents the object or person. 

The value of identifying these levels is in the idea that the Indi- 
vidual student’s perception can be categorized so his next step in learning, 
can he presented to him at an appropriate level . Representation at a 
level in which he is still doubtful could be reinforced, then, by represen- 
tation at a level in which he has confidence until the transition is sat- 
isfactorily made to the next higher level. 

Goal areas categorize families of concepts dealing with (t0 temporal 
relationships (’’juice time," etc.), (Id) special relationships (specific 
position), (c) seriation relationships (ordering), and (d_) classification 
relationships. Curriculum writers outline lesson plans, then, with a 
description of the goal area. For each representation level suggested 
materials and activities are offered, while for one level a complete out- 
line of activity at that level is presented. Such a plan is seer as suf- 
ficient in allowing the teacher to adapt the plan to representation 
levels appropriate to students 1 needs. An important factor in teacher 
preparation (staff development) is that the teacher make the presentation 
naturally, not in a rote, ritualistic manner. 



Atmosphere of the Project 

One component: in the reason for the project’s local acceptance is the 
part played by parental involvement. The majority of parents believe that 
this school is doing something worthwhile in comparison to the "old” 
school, and many of the parents are participating, either in their chil- 
dren's education, or in getting an education for themselves. This involve- 
ment of parents initially began with the organized presentations by 
members of the lay advisory committee, who are drawn from the community. 
There was also personal contact with every family, which entailed door-to- 
door work. The administrator of the parental involvement program emphasized 
quite strongly the need for reaching ALL the people of the community. 

Another important factor was determining and serving the needs and interests 
of people in the community, so that the school could become a community 
learning center in a true sense — not merely a place for "schooling kids." 

The personality of the Principal, who is also the onsite Project 
Director, is a factor to be considered in this project. He seems to pos- 
sess a unique combination of being both a highly competent administrator 
and a sensitive human being. With a combination ol firmness and sensitiv- 
ity, he is seen as providing guidance and encouragement to staff, students, 
and community people, for generating their own individual self-confidence 
and decision-making ability. 

One aspect of the activities at the Learning Center previously 
mentioned within this profile is their attempt to establish need ful- 
fulling relationships between the people involved. One example of this 
is in the operation of the pupil personnel services . 
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The whole department has acquired a different relationship to the 
student population from that usually associated with such a department. 
They have become known as “the school helpers,” with the result that 
pupils come to members of this department whenever they feel they need 
help, without waiting to be "found" and referred. There is a sense 
of confidence about the whole operation. 

The tutorial program is under the supervision of this department, 
particularly the visiting teachers, where older children are assigned to 
ti or younger children on the basis of ability in the needed subject 
ai ia and compatibility between the children (which has proved to be little 
trouble: tutors appear to take a very personal interest in their charges, 

which promotes a healthy relationship). This helps in working toward 
the elimination of special education as a separate activity catering 
to "slow learners," since they are drawn into the mainstream where they 
are no longer “slow." 

Another example of this need fulfilling aspect being worked for in 
the project is in the music programs. Each of these subjects is handled 
as an integrated and individual means of expression. The teachers work 
toward techniques for achieving this and developing the “natural" talent 
of the children. To watch a 3- or 4-year-old stand with pride before an 
audience, and perform on the violin with a precision that justifies that 
pride, the observer can see why that youngster has a start that gives 
him (or her) confidence in tackling other activities as the time comes. 
Introduction of students to music, often involving their parents as well, 
is designed to provide success which subsequently will be reflected in 
their confidence and improved performance in other subject areas. 
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Chapter VI: Training replications 



Usually this chapter wouiy carry suggestions about the training a person 
would need in working on the project that the profile is describing. In 
this instance, 11 implications" can have a somewhat different connotation, 
for this project is where to get trained for this kind of work. It is 
true that the project is not a training program, per se. But training 
is definitely an integral part of it. 

The personnel hired as center teachers, curriculum writers, and 
site coordinators, have backgrounds that equip them for the teaching 
level or curriculum content involved, and probably with teaching in 
schools that serve the same kind of population. They are also involved 
intimately with staff development, which is training. 

Thus, in this context, training to work in such a project is not a 
separate, preparatory function. The project is concerned with diffusing 
learning programs adapted to the needs of the specific school setting 
into which they are adopted. And part of this dif f using-adop t ion process 
is concerned with being sure that the pecpie who use these materials 
to produce these learning outcomes are properly equipped to do so. 

During the visit, several expressions were made about the value of 
exchanging roles within the centers, so that each member of the team 
spends time teaching from the outline, making observation of the other 
member(s) teaching, trying out writing skills in making appropriate 
modifications, and so forth. This procedure would seem to apply the 
"two heads are better than one" principle for the benefit of the work 
turned out, which is reason enough in the project’s eyes for using it. 

However, as a training implication, it provides broader experience 
within the same time span and thus gives these people far better prep- 
aration for future work of this type, either working :n teams or as 
single individuals. The formal observing for the purpose of gathering 
data serves a quite precise purpose on this project, a purpose that may 
ue applied at other times on other projects. But it will have an 
influence on the activitiy of the person, should she work in the future 
as a classroom teacher, because she will be sensitized to using this 
kind of observation. 

So one implication to be drawn from this project is that some aspects 
of the way it operates could provide mechanisms for training. Possibly 
the kind of measures or instruments used here could be adapted for use 
in a student teaching situation to provide a discipline facilitating the 
student teacher's observing the experienced teacher in action, and then, 
when roles are exchanged, to provide the experienced teacher with a 
mechanism for recording observations on the student teacher's performance. 

On this project, the main function of this procedure was not to 
monitor teacher performance, but to measure the adequacy of the materials 
for teacher use in producing learning outcomes. Another possible implication 
of this activity for training purposes is that use in the way described 



o 



1044 



.-iIjovi- i <hi M In* l t ot prepare leacheru .mil student teachers to adapt 
c/lhi 1 1 1 >• materials lor iiho with t hi' student population I ouud In llioir 
own classroom. 

This could be a piece of training virtually putting tlie benefit 
of RDD&E right within the instant of teaching in a classroom situation. 
This kind of training could possibily sensitize teachers so that they 
are able to observe deficiences on the spot and correct them for the 
benefit of the students there present. Such action may not qualify 
for the current definition of RDD&E because it forms part of a day’s 
teaching activity, but it might be an application of RDD&E methodology 
that could be considerably valuable. 

In writing this, it is recognized that this response to the 
question implicit in the chapter title differs from the intended tar- 
get of that question. However, it is believed that in light of the 
Dunbar Project the observation thus presented could prove even more 
useful in its impact on education than responses of the form implicitly 
expected . 
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Appendix: Listing of Output Standards, Tasks, and Enablers 




f 



The following is a list of standards, tasks, and enablers for out- 
puts around which interviews were conducted. These statements were ex- 
tracted from discussions with interviewees and were coded into their 
respective category sets. The selected code precedes the statement and 
indicates the following for: 



STANDARDS 

Code J: Structure of Standards. 

J-l Standards against which outputs are judged. (output oriented) 

J-2 Standards against which processes and/or operations are judged, 

(process oriented) 

Code LM: Primary Categories of Standards. 

TASKS 

Code NO: Clusters of Tasks. 



ENABLERS 

Code S: Structure of Enablers 

S-l Knowledge. 

S-2 Skill or ability to perform. 

S-3 Sensitivity or awareness. 

Code UV: Primary Categories of Enablers (knowledges, skills, or sensitivities) 



The codes associated with these three categories (standards, tasks, 
enablers) are the same both here in the listing and as previously cited 
in Chapter III tables. 



E-01: Revision of Student Learning Program 

in Communication Skill (SWRL) 



STANDARDS 
J LM 

1 12 Enable children to read, understand, unlock words more 

efficiently . 
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2 07 

1 12 
1 12 
2 15 

2 24 
1 12 

TASKS: 

NO 

04 

04 

04 

03 

04 

04 

04 

29 

03 

04 

04 
24 

05 

04 
29 
07 

05 
03 

05 

02 

03 

04 

04 

06 

05 



Teachers raised questions at district-wide staff develop- 
ment meetings about things they need. 

It is learning as well as fun. 

Results of tests were good. 

Fifth grade tutors accept responsibility for and interest in 
second grade students. 

Second grad' 1 students shared benefit. 

Students demonstrate reading-thinking skills. 



Write into the SWRL program items to bridge gaps found in 
use at local setting to make it more effective. 

Develop new items to help children in the center. 

Write a scope and sequence analysis of approach to phonics, 
titled "Steps to Word Attack Mastery." 

Devise a method where students learn to assess themselves . 

Write reinforcement for characters in SWRL program in form 
of audio-flash cards. 

Produce work wheel to produce variations of letter combinations 
Generate small books using cartoon characters. 

Work with classes that have study problems. 

Develop curriculum plans to use dictionary in 1st and 2nd level 
Construct tests, for use with course. 

Construct second year mastery test (not in SWRL) . 

Devise better ways of making tests — finer differentiation. 

Try revision and further testing for little group that did 
not do well, when all rest did. 

Make up pre- and posttest. 

Work with groups of six children for two , three, or six weeks. 
Train children to use SRA lab materials. 

As teacher, act as supervisor, to keep active students occupied 
Devise method of encouraging higher scores and helping lower 
scorers . 

Have student checkers average scores, as math reinforcements 
to them. 

Get help from others in constructing tests. 

Design the tests. 

Provide materials for tutoring program, using flash cards 
and ultra flash speech test. 

Include guidelines for interpretation of student performance 
in program. 

Verify that important parts are included — phonetic analysis, 
following directions, interpretation ana comprehension. 

Pilot test materials in whole class with home room teacher. 



ENABLERS : 



S UV 
2 -01 
1 02 



Remembered things that were effective as classroom* teacher. 
Background at reading clinic — all levels. 
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E-02: Revisions of Student Learning Program in 

Multicultural Social Education (SEDL) 



STANDARDS : 

J LM 

1 12 75% achievement by 75% of students. 

1 06 Teachers judge objectives appropriate. 

1 12 88% achievement by 88% of students was standard for expansion. 

2 34 Teachers enjoy program. 

2 34 Students have fun — laugh, enjoy. 

1 01 Form is complete when spaces filled in. 

TASKS : 

NO 

05 Pilot test the Multicultural Social Education Program at 

this school witn six teachers. 

05 Observe the pilot test teachers using the program. 

29 Help oral conferencer with pilot test teachers using 

the program. 

06 Study the material to improve it. 

06 Study the weakness of the program. 

23 Select expanded field test sites according to ethnic student 

population. 

06 Revise the program based on student data. 

05 Gather information and data on master analysis forms and 

send to regional laboratory. 

29 Sit down with teachers at the end of each unit and hold oral 

conference . 

05 Fill out oral conference form. 

05 Collect the data from checklists and put it all on master analysis 

form. 

05 Review the master analysis form to determine what is wrong 

with program. 

29 Hold orientation meeting with teachers to explain use of program. 

07 Demonstrate how to use program to older more traditional teachers. 

32 Bring groups of principals in to watch the students 

operate on program. 

23 Help select satellite schools based on principals’ reactions. 

05 Administer TABA test as standardized test to students. 

05 Administer program pretest in the fall. 

05 Administer program posttest in May. 

05 Analyze data from teachers. 

05 Interpret data from teachers. 

05 Observe and record data. 

06 Teachers critique the lesson. 

31 Teachers explain how to improve. 

05 Review the master analysis form to determine the basic problem. 




/ .*■ * 
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29 Emphasize that i want t o observe the lesson not t lie teacher. 

29 Emphasize the importance of data. 

05 Analyze the written comments on the evaluation form. 

ENABLERS: 

s uv 

1 05 Knowledge or previous success of program. 

3 04 Not to push self on teacher if they did not want me. 

3 02 Sensitivity to other people’s problems. 

3 16 Sensitivity to individuals, not classes such as black or white. 

2 25 Sensitivity to older teachers being more difficult to change. 

3 02 Sensitivity to older black teachers not having training. 

3 16 Sensitivity to black-white problem. 

3 16 Sensitivity to youth-age problem of teachers. 

3 16 Sensitivity to man-woman problem of teachers. 

3 22 Sensitivity to teachers’ fear of consultants (educator). 

2 01 Skill in teaching children — demonstrating. 



£-07: Revision or Student Learning Program in 

Orff-Kopaly Music 



STANDARDS: 

J LM 

2 34 Children enjoy themselves. 

1 08 Consultants and teachers all agree on the attainment of the 

objective by subjective judgment. 

2 34 The enthusiasm shown by students indicates success of a lesson. 

TASKS: 

NO 

04 Change from Hungarian folk rhythms to African beats . 

02 Visit consultant to learn about Orff-Kopaly music program. 

04 Write lesson plans for teaching Orff-Kopaly music program. 

03 Design the lesson plans to give the children instant success 
in their lessons. 

03 Design the lessons to make success a habit. 

29 Involve the children in the lesson planning. 

31 Listen to consultant lecture on the Orff-Kopaly techniques. 

05 Give pre- and posttests to small samples of children. 

05 Have teachers fill out lesson observation forms. 

24 Call in consultants to observe students at various times. 

03 Send more students in for the lesson when it is improved 

from last group. 

07 Conduct seminars for teachers from other schools in the Orff-Kopaly 

methods . 



A 
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07 Disseminate materials (lesson plans) to the other schools. 

22 Obtain approval on budget needs from the central office. 

05 Write down on observation form actual behavior of students 

and teachers during lesson. 

0A Write lesson plans as guidelines leaving teacher some leeway 

to improvise. 

ENABLERS: 



s uv 
1 01 
1 01 
3 A 5 
3 03 
2 02 
3 A6 
2 01 
3 03 
2 Al 

2 30 

3 A 5 
3 22 
3 0A 

3 03 

2 16 
2 16 
3 17 
3 3A 



Knowledge of rhythm symbols. 

Knowledge of tone.. 

Musical sensitivity to tone distinctions. 

Sensitivity to needs of children to enjoy learning. 

Skill in amusing children. 

A sense of humor. 

Skill in teaching music. 

Sensitivity to children’s need for change-versatility. 

Energy — good physical conditioning. 

Flexible personality . 

Good ear for music. 

Sensitivity to short span of attention in K-3 age group. 
Sensitivity to part played by teacher’s personality in any 
lesson learning. 

Sensitivity to need of students to have a male image in school, 
particularly in music. 

Skill in singing. 

Skill in playing the piano. 

Realize that muscians are often temperamental. 

Willing to accept criticism. 



Revision of Student Learning Programs in David Weikert 
Early Childhood Education (SEDL) 



STANDARDS: 

J LM 

1 01 Four levels of abstraction or representation adequately 

identified . 

1 01 Four basic goal areas in "relationships" are included: 

temporal, spacial, seriation, and classification. 

1 12 Children appear inquisitive. 

TASKS: 

NO 

0A Write "cookbook" strategies for teachers to use, identifying 
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levels of representation or abstraction. 

01 Identify level of abstraction at which individual students 
work. 

02 Establish goal areas for relationships. 

02 Write behavioral objectives for one week at a time. 

04 Recycle lessons from last year, utilizing response data. 

02 Write complete objectives for one level of relationships, suggest 

objectives at other three levels. 

02 Try to incorporate humanistic approach with behavioral 

objectives written around levels and goals. 

04 Take best parts of the three programs to develop "Gateways 

04 Write rationale for "Gateways," 

04 Move from "pure" Weikert to best of each bilingual from SEDL, 

Weikert, Distar (SRA--ingleman) . 

04 Design own evaluation procedures. 

04 Design a daily random assessment for objectives (for teachers needs). 

02 Sets goals for week (for teachers). 

04 Write cognitive awareness pre_ anc j posttest. 

03 Design procedure for measuring each concept at each level. 

05 Follows testing procedure for each concept from top level 
down (with students). 



ENABLERS: 

s uv 

2 03 Skill in writing learning packages. 

2 06 Skill in adapting format from Unipak to Weikert Strategies. 



Staff Development Package for Student Learning 
Program in SEDL. 



STANDARDS: 

J LM 

2 33 Teachers’ knowledge of strategies as well as skill in 

applying them. 

2 15 Teachers* know when to employ particular strategy. 

2 12 Teachers* have knowledge about objective for strategy, level 

of cognition involved. 

TASKS : 

NO 

29 Work with teachers in social studies. 

29 Work with teachers city wide in staff development in 

social study teaching strategies. 
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29 

29 

04 

21 

21 

06 

24 

24 

05 
04 
21 
21 



07 

31 

07 

06 

03 

03 

03 

03 
21 
21 

21 

21 

21 

21 

04 
04 

04 

04 

04 

04 

ENABLERS ; 

s uv 

1 05 

2 01 
3 30 
2 37 



Work with multiculture program materials from neighboring city. 
Work with Hilda Taba strategies. 

Use techniques derived from strategies to write new material for 
other subjects, grade levels. 

Train teachers using 42 hours of training material with 100 
teachers from satellite schools in 12 sessions. 

Put on followup sessions in classrooms using plans developed 
during sessions. 

Critique instructional plans and strategies used, using 
discussion analysis. 

Give teachers some feedback about their efforts. 

Review tapes made of work for critique. 

Go into classroom to look at teacher’s performance. 

Prepare participant manuals to show what to do. 

Train teachers to build discussion plans. 

Use role playing at child level, to concentrate on process 
rather than content, which results from using adult-oriented 
Taba materials direct. 

Get student teachers to use the plan in their own classrooms 
and to develop otheis. 

Get feedback at subsequent meetings of the course. 

Get teachers to use tabulated Taba strategies and add others — 
extemporize . 

Workers simplify Taba strategies — still need more. 

Develop focusing, opening (open-ended) questions. 

By knowing the class, call on reticent ones first. 

Develop questions leading to interpretation of feelings. 

Accept dominant answer, then ask for ’’others/' 

Teach use of nonverbal expression^-looks , actions. 

Emphasize preparation for doing things unplanned, that 
just ’’pop up.’’ 

Teach teacher variety in question statement, to get all 
students "tuned in." 

Emphasize need to get children to interpret or infer. 

Emphasize change in teacher’s role, questioner, not "teller." 
Assist teachers with collecting data and applying feed- 
back from data. 

Develop staff development package for subject area. 

Write rationale, objective of the program, participant manuals, 
awareness experiences using teacher role playing. 

Develop evaluation instruments. 

Produce visual, transparencies, with audio tapes. 

Produce video tape of a teacher using Taba strategies (use 
as part of package). 

Write discussion possibility guides for participants’ manual. 



Familiarity with Taba strategies. 

Skill at working with Taba strategies. 

To the behavior and thought patterns of children. 
Recognizing abilities of children. 






2 29 
2 42 



in maintaining working relationships with teachers. 
In promoting feedback from teachers. 



P-41: Quarterly Budget Summaries 



STANDARDS: 

J LM 

1 14 Sponsor accepts the budget. 

2 04 Budget is submitted on time. 

2 24 Funds are expanded for things that reflect well on sponsor. 

1 15 No communists allowed on budget. 

TASKS: 

NO 

22 Maintain an accounting record on all expenditures, projected 

expenditures 9 and budget comparisons. 

04 Prepare a quarterly budget for the sponsor. 

04 Supply the rationale for all items included in budget. 

24 Review the budget with sponsor. 

06 Eliminate people from data processing budget in early days 

because they were not needed at that point in time. 

22 Submit a projection of cash needs each month. 

22 Submit a comparison of actual expenses with projection 

by 10th of the month. 

22 Submit a quarterly budget to the sponsor. 

22 Report to Superintendent concerning budget. 

22 Report to Associate Superintendent for development 

concerning budget . 

22 Report to Assistant Superintendent for planning and evaluation 

concerning budget . 

ENABLERS: 

5 DV 

3 01 Sensitivity to desire of sponsor that every dollar goes to 

improve education of disadvantaged youngsters. 

1 06 Knowledge through experience of what the sponsor will reject. 

1 21 Knowledge of business operations. 

2 44 Skills in accounting. 

3 16 Sensitive to public image of sponsor. 
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P-43: Process Evaluation Report for Revised 

Student Learning Program 



STANDARDS : 

J LM 

2 39 Evidence in design of preplanning — e.g., where is next 

stage going? 

1 12 Procedures adequately investigate the effects of the program. 

1 21 Data collected on adequate control groups. 

1 11 The questions are ones they want answered for this project. 

1 01 The sampling procedures used permit answering the questions. 

1 05 The results are as generalizable as possible. 

TASKS : 

NO 

24 Look at the questions in general to see whether they are 

comprehensive and are answered by design. 

06 Examine results to see whether questions are answered. 

06 Look at sampling procedures to see if adequate. 

ENAE^ERS : 

1 UV 

1 03 Research design applicable to question to be answered. 

2 10 Understanding inferential statistics. 



053: Parental Involvement 

Program 



STANDARDS: 

J LM 

1 22 Numbers of parents become involved in their choice of 

helping activity. 

2 07 Presentation made at one neighborhood church every Sunday. 

2 17 More than 500 parents a month go through the homemaking 

program. 

2 17 25% of enrollees in black studies course are white. 

2 17 Support (attendance) from wide geographical area on many 

programs . 

2 17 They have surpassed expectations in more programs than they 

would have planned — effect of self-motivation. 
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TASKS' 

NO 

02 Write community — embracing objective as goal for activities 

and statement of individual goals. 

01 Visit several major cities throughout the nation seeking 

suitable programs. 

23 Set up Lay Advisory Group to determine needs of various 

segments of community; children and adult. 

33 Lay Advisory Group changed the composition of the school boards. 

01 Study economic and social needs as well as educational needs 

of community — first welfare needs. 

29 Attempt to reach parent through children, using program that 

child is interested in. 

29 Let the parent contacted know that program exists to help 

(1) child, (2) parent, (3) community — in that order. 

01 Be careful to promise only what program can and will do. 

29 Show interest in condition at home and neighborhood. 

29 Show interest in religious affairs through churches. 

29 Associate with all kinds of characters in community. 

29 Make each parent an important factor in the program. 

07 Educate parents to accept decision-making role for school 

and community. 

29 Encourage parents to bring in ideas; to volunteer help. 

04 Develop PAL (Parent Assisted Learning) program. 

29 Help parents find avenue to volunteer. 

25 Let participating parents recognize that they are succeeding 
in the program. 

29 Use volunteer help in swimming program, e.g., when school 

not in session. 

04 Write booklet, "How to Implement Parental Involvement." 

04 Publish newspaper. (16-page) 

04 Prepare Early Childhood Handbooks for parents. 

04 Complete Parental Participation Handbook to show how 

schools can encourage parental participation. 

31 Conduct monthly meeting with all parents of early 

childhood children . 

29 Work with parent on how to teach children. 

01 Determine interests of groups of parents. 

29 Provide classes to meet interests, e.g., ceramics. 

23 Get permission to make presentations at neighborhood churches. 

31 Put on programs at churches to get support of community. 

Arrange to make presentation at on** church every Sunday. 

04 Establish adult-based education. 

26 Promote completion of high school education. 

04 Initiate programs in typing, sewing. 

29 Sponsor: oratorical contest, Campfire Girls, counseling programs 

for girls, PTA, Lay Advisory Committee, Early Childhood Advisory 
Committee, PAL Program, Suzuki music program, homemaking program. 

29 Avoid terms like "home economics," but offer content in terms 

understood to them. 

25 Establish self-realization concept across other programs. 

04 Incorporate "black studies" presentations, using local, successful 

blacks . 



* 
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04 


Establish Red Cross volunteer program in 


first aid. 


25 


Conduct voters registration 


drive; encourage to vote. 


29 


Conduct income tax seminar. 






29 


Set up seminars on drug abuse. 




29 


Sponsored summer program in 


recreational 


activities . 


29 


Establish young adult club; 


to prepare future parents for 




Involvement . 







ENABLERS : 

3 UV 

3 01 Rave to love people. 

3 13 Sensitivity in using language people understand. 

2 02 Must be prepared to reach everyone in community on person-to- 

person basis. 



n 



054: Coordinated Cmriculum 



STANDARDS : 

J LM 

1 26 Test items are developed according to levels of thinking. 

1 19 Test items test what they should be testing. 

I 12 Findings show effectiveness of learning against specified 

obj ect ives . 

1 04 Wording is in a form that any teacher will understand what 

the curriculum material is calking about. 

1 16 Writing is within the field — it has construct validity for 

purpose. 

2 17 Home-based teachers view involvement in center as ’’promotion," 

TASKS : 

NO 

21 Appoint working center curriculum coordinators. 

21 See that working center coordinators understand data collection or 

subject of working center. 

24 Supervise remedial efforts necessary in working centers. 

21 Make recommendations for new staff selection. 

25 Discuss interpersonal problems. 

22 Monitors budget allocated to each center for cost /effect iveness . 

22 Check requisitions against cost/ef feet iveness and budget allocation 

31 Schedule a meeting for a day, one a week, with each center. 

25 Goes over program objectives, philosophy, and rationale. 

24 Check what curriculum centers have done. 

33 Discuss where we go from here. 



